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Roc  en  (  result'  tor  re  t  t  i  r  *•  ill  ''lnsini  !  i  "M  t  .  c  t  .i  sepo  u . 
ot  suitable  sealed  stochastic  processes  are  .implied  to  the 
s  v  nch  ron  i  r.a  t  i  on  problem  tor  a  digital  phase  locked  loop  t,IM'll  '  . 

The  discrete  tune  para  net  er  error  procosso->  is  suitablv  amp  :  *  ud.e 

sc  a  l  e  d  and  i  n  t  e  r  po  l  a  t  ed  into  a  c  on  t  i  nuou s  time  ;>;ii  aiiirt  er  p  r  v  e  s  ■ 
For  small  filter  r, a  i  n *•  and  s vmbo  l  intenab.  ,  a  d  i  l  l  us  i  or  i-  v  vess 
approximation  is  manouslv  obtained.  .  Mi  i  s  approx  una!  ion  i  ■■  a 
batiss  Markov  process  and  it  viold--  app  tox  niat  e  error  variances, 
passage  time  distributions,  correlation  properties,  (amoiu;  otbet 
propert  ies)  for  the  Pi’ll  .  fhe  trackinr.  problem  when  the  clock 
drifts  is  a  fronted.  The  technique  is  applicable  to  a  wide 

varietv  ot  relateil  problems,  t  c  ret  cent  unions  t  i  me  Markov  systems 
which  are  easier  to  ana  l  y. to  the  ornunal  tcont  inuous  or  discrete 
time)  svstems  which  tliev  approx  imatv  . 
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1 .  I n  t roduc t i on 

In  Chapter  v>  o  f  [1J,  Lindsey  and  Simon  develop  Severn! 
interesting  digital  phase  locked  loops  (PI'LL)  for  the  purpose  of 
svmbol  synchronization.  In  theireifort  to  estimate  the  vari.ino.'v 
of  the  epoch  estimation  errors,  it  was  assumed  that  the  bPl.l. 
adjustment  rate  is  slow  and  the  errors  small.  I  hen  an  "c.i i  va  !  ent  ’ 
phase  locked  loop  (PLL)  was  found ,  with  an  "equivalent"  white 
noise  input.  The  error  variance  of  a  1  ineari  zed  form  of  this  f!.l. 
was  then  used  as  an  approximation  to  the  error  variance  of  t^e  PPL:  . 
In  the  development  of  such  a  continuous  time  parameter  nnp  vox  itna  t  'r' 1 
there  arc  for  must  be)  either  implicit  or  explicit  amplitude 
scalings  of  the  signal  and  noise  and  of  the  system  gains.  By 
speaking  of  an  "equivalent  I’LL”,  and  using  it  to  estimate  the  error 
variances,  there  is  at  least  the  tacit  recognition  that  *'or  some 
suitable  amplitude  scaling  of  the  error  sequence,  there  is  a  con¬ 
tinuous  parameter  interpolation  of  the  error  sequence  winch  l  - 
close  in  some  statistical  sense  to  the  output  of  the  "equivalent" 
PLL.  But  the  exact  sense  in  which  the  Pld,  is  "equivalent"  or  clo-c 
is  not  clear,  owing  to  the  informality  of  the  development  and  tin 
of  a  spectral  analysis  technique  which  fixed  the  state  variable, 
and  does  not  allow  it  to  vary  naturally.  The  general  idea  is  useful 
however,  since  owing  to  "contra  1  limit  theorem"  like  effects,  tv 
complicated  detailed  structure  of  the  PPM.  would  be  replaced  by 
a  PLL  with  a  white  noise  input,  which  is  easier  to  analyze.  When 
speaking  of  closeness  of  a  PI’LL  and  a  PLL,  we  might  mean  that  if 
the  PI’LL  were  parametrized  (by,  say,  the  symbol  nteral  T  or  by 
a  system  gain),  then  as  the  parameter  converged  to  (say)  zero,  the 
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output  of  the  DPLL  converged  in  a  suitable  sense  to  the  output 
of  the  PLL.  Here,  a  systematic  and  rigorous  way  of  doing  this  is 
developed.  The  technique  has  wide  applicability.  The  specific 
end  results  are  of  the  same  type  as  obtained  in  [1],  except  that 
owing  to  the  "weak  convergence"  nature  of  the  approximation,  much 
information  on  the  DPLL  beyond  the  error  variances  can  be 
(approximately!  obtained  from  the  limit  process. 

Recently  a  very  useful  technique  [2]  has  been  developed  for 
getting  precise  (in  a  sense  to  be  described  below)  diffusion  limits 
of  a  sequence  of  suitably  scaled  (and  suitably  interpolated  into  a 
continuous  parameter  processes)  stochastic  difference  equations.  h 
these  methods  are  applied  to  the  synchronization  problem,  and  the 
correct  approximating  diffusion  is  obtained  in  a  mathematically 
rigorous  way.  The  limit  could  conceivably  be  interpreted  as  the 
output  process  of  a  particular  PLL  whose  input  noise  is  white 
Gaussian.  But  the  important  thing  is  that  it  is  not  necessary  to 
make  ad-hoc  assumptions  in  the  development.  iiie  method  can  be 
used  to  handle  a  wide  variety  of  structurally  similar  problems 
in  a  systematic  way.  For  specificity,  we  treat  the  scheme  of 
Figure  9.34  of  [1]  under  the  noise  assumptions  there.  See  figure  1 
for  the  system.  The  same  general  scheme  has  been  applied  to  other 
problems  in  [3];  namely,  to  get  diffusion  approximations  to  the 
"state"  processes  of  a  learning  automata  for  adaptive  telephone 
routing  and  an  adaptive  quantizer.  The  diffusion  approximations 
are  much  easier  to  study  than  the  original  processes.  Related 
"continuous  time"  methods  have  been  applied  in  [4]  to  several 
"continuous  time"  problems. 

We  do  not  emphasize  this  because  the  limit  equation  is  quite 

simple-and  an  interpretation  is  not  helpful. 


The  specific  problem,  scaling  and  interpolation  will  be 


developed  in  Section  Z.  The  development  is  for  the  simple  case 
connected  with  ([1],  Figure  9.54).  Intensions  to  more  general 
noise,  intersymbol  interference  and  clock  drift  are  discussed  in 
Section  5.  As  will  be  clear,  the  technique  gives  more  information 
than  simply  an  approximation  to  the  error  variance.  In  Section  5, 
the  general  background  theorem  is  given,  together  with  some 
definitions  from  the  theory  of  weak  convergence  of  a  sequence  of 
stochastic  processes.  In  Section  4,  the  theorems  of  Section  5  are 
applied  to  the  problem  of  Section  2,  and  the  main  limit  theorem 
ob t  a i ned . 


I  h  i  _ _ _ _ _ _ _ 

1  Distribution/ 

I  AvsilnMlity  Codes 


A .nil  and/or 
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2.  The  DPLL;  formulation,  scaling  and  interpolation 

The  circuit  is  given  in  Figure  1,  and  Figure  2  gives  the 

timing  sequences.  In  this  section  and  in  Section  4,  the  signal 

sequence  (s^l  a  sequence  of  independent  random  variables, 

where  s  =  tA„  and  P(s  =  A.,}  =  |  ,  and  s  (t  1  =  input  signal  = 
n  u  n  u  c. 

s  in  the  interval  lnT+Sn,  nT+T+6  ),  where  6  is  the  unknown 
n  (l  0  0 

epoch  which  is  to  he  estimated.  Since  only  the  estimation  errors 
are  important,  with  no  loss  oi  generality  we  set  =  0.  The 


input 

noise 

nT(t  1 

is  whitt 

?  Gaussian, 
ft 

and  its 

’  power 

will 

be 

given 

below. 

Le  t 

wT(t)  =  J 

nT(s)ds  = 

0 

ind  w.r(-l 

Wiener 

process 

w  i  t  h 

var i ar 

°Tt  ‘ 

We  sub' 

'  c  r  i  p  t 

nT ( • 1  : 

by  T 

for  reasons 

to  be 

discussed  below  (2.31.  More  general  signal  and  noise  models  will 

be  discussed  in  Section  5.  Let  e  denote  the  nt*1  estimate  of 

n 

*0  and  SCt  Xn  *  tW/T  =  V1' 


The  algorithm.  Using  the  two  parameters,  define 

e  (•»•)  (see  Figure  11  by 

(2.11  enCVl’V  =  lsn(1'A_An-l)T  +  sn  +  l  U  +  Xn)  1 

+  wT((n+l+A+Xn)T)  -  wT((n+A+Xn.])Tl! 

-  lSnCA’An-l VI'  +  Vl0^11' 

+  Wj(  (n  +  2-A  +  Xn)Tl  -  Wy((n+1  -  A  +  \n.  ]  )  |  • 


Throughout,  it  is  assumed  (as  in  [ 1 ]  1  that  a  <  1/4.  With 
use  of  a  general  finite  memory  linear  filter,  { 1  ,  is 
defined  by 


(2.2) 


t.  =  £  +  y  T  a .  e  .(a  .  ,  ,  A  .). 

n  +  1  n  1  n-xv  n-i-1  n-ij’ 

,  K 

\  =A  +  —  T  a . e  .  ( A  ,  ,  A 

n  +  1  n  T  .  i  n-i1-  n-i-1  n-i;’ 


where  Y  >  0.  The  technique  for  (2.2)  is  very  similar  to  that 
for  (2.3).  The  limits  all  have  the  form  (4.1)  and  differ  only  in 
the  power  of  the  input  noise  and  in  0  being  replaced  by  My  ■* 

We  will  work  with  (2.3)  for  simplicity,  where  g  (.\ ,  >  '  )  =  c  (/.!')/ 


(2.3) 


.  =  A  +  =■  c  ( A  .  ,  A  )  =  A  +  y  r  (  a 

n+i  n  T  n  n-1  n  "  i  . 


n  n  - 1  ’  n 


In  any  particular  application,  where  T  is  fixed  a-priori, 

is  determined  from  the  problem  data.  But,  consider  a  sequence 

of  systems  of  the  form  (2.3),  the  sequence  being  paramct ri zed  by 

T  +  0.  Assume,  for  purposes  of  this  argument,  that  c  =0,  and 
T  n 


that  SqT  +  j  n^,(s)ds  =  yp  is  used  to  estimate  sp  via  a  likelihood 
ratio.  Thus,  if  y  p  >  0,  then  sp  =  Ap  >  0  is  chosen.  Note 


Pfchoosing  sQ  =  AQ  >  0|  sQ  -  -Ap'  =  j  A  ^  dN (0,1), 

o  /F 


where  N(0,1)  is  the  standard  normal  distribution.  Thus,  a  natural 

2  2 

parametrization  is  o-j.  =  o  T  for  some  constant  o.  Note  that  the 
(noise  power  in  a  bandwidth  of  order  l/T)/signal  power) is 

constant,  under  the  above  scaling. 

As  Y  ■*  0,  the  continuous  parameter  inter"  •>1  at  i  on  (interpolation 
interval  Y)  of  T A n }  converges  to  the  solution  of  an  ordinary 
differential  equation 


which  will  not  yield  the  detailed  path  information  which  is 


desired.  A  further  normalization  is  required  for  this.  It  is 

convenient  to  write  g  (A  . , A  )  in  the  form 

fen  n  - 1  n 

snCVr'p.>  ■  i<1-6‘Vi)sn  *  o+An)sn+i 

♦  w(n+l+A+A  )  -  K  (n+A  +  .\n_  ]  )  ; 

-  ;  i  . ..  is  +  f  1  -  A  +  a  is  ,  +  win+d-A*  •  ,  ■  w  .  n  •  .  ■ 
•  '  ••  n-  1 }  n  1  n  -  n  + 1  n 


where  w  (  •  )  is  a  Wiener  process  with  variance 


c  t  . 


Next,  define  U  =  A  / /y  and  define  the  process  U  (•)  hv 
n  n 

II 1  ft)  -  Ur  on  each  interval  [ni.nv  +  v).  With  parameter  '•  , 


replacing  'n-l,A'n’  it  ( A  ,  \  )  s  1 ;  c  n  l  ^  and  define 

s  ^  ( A  .  ,A  1  g  (A  .A  )  -  g(\  A  ).  We  can  now  write  the 
n  v  n  - 1  n  n  ^  n  - 1  ’  n  ’  i  v  n  -  1  n 

normalized  and  centered  iteration  as 


(2.4) 


u  ,  =  u  +  r(.g(A  .  )//v )  +  ,ry  c,  (A  \ 

n  +  1  n  n- 1  nJ  n  n-  1  n 


Define  the  derivative  ^  g(A,\)[^_Q  =  -e .  ;t  can  be  shown  that 
d  ■>  0 .  For  the  analysis,  it  is  convenient  to  expand  (2.4)  as 


(2.5) 


U7  .  =  U7  -  Ydu7  +  y v 
n+1  n  n  n 


/>■;'( A  ,  , A  ), 
n  n  -  1  ri 


2  2  v  v 

where  v^  are  0 ( | A  n |  +  |A^ +  1 1 1  ^ - U  r  ^ |  )  and  O(x)/  x •  is 

bounded . 

The  limit  theorem  of  Section  4  implies  that  ' '  ("it  converge 
in  distribution  to  a  particular  Gauss-Markov  oil  lesion  U  ( •  )  as  x  * 

+We  can  define  w(t)  -  Wy(tl)/T. 


This  limit  would  he  the  output  of  the  "equivalent”  PI.L,  and  onlv 

makes  sense  as  a  "near  equivalence"  if  y  is  small.  In  the  cited 

section  of  [1],  it  is  also  supposed  that  the  error  estimates 

chance  slowlv  (small  r)  and,  in  fact,  that  the  X  are  "constant" 

n 

over  a  "lone  period"  of  time.  The  latter  extraneous  assumption 
is  not  needed  here. 

Properties  of  {A  }  are  obtained  from  X  =  %/y  lly  •  ■ 

'  n  n  n 

or,  equivalent  1 v ,  from  (n  1  =  t) 

( -  -  0)  A  U(t)  \it/y  -  />  U(nT-J)  . 

\1  though  the  result  does  not  depend  on  it,  t  would  normal!;.'  a  open, 
on  T.  and  the  limit  results  suggest  the  appropriate  form  of  tie 
dependence.  Since  we  arc  concerned  with  the  behavior  of  ■' >  } 
over  real  time  intervals  {n:  nT  <  t)  ,  by  (2.t>)  we  should  have 
>  -*  0  as  T  -*•  0 .  If  y/T  -*■  0  as  T  -*  0 ,  then  (2.6)  implies  that 
the  system  output  becomes  {U  ].  constant  on  any  finite  time 
interval  as  T  -v  0.  Let  nT  =  t.  If  y/T  -  «  as  T  *  <* ,  then 
‘  [  t  /  t  ]  ^  U(nT*y/T)  -  U(-)  (U  (°° ")  has  the  limit  distribution, 

as  t  -*  00 ,  of  U(t))  .  In  particular,  let  )  =  c'f\  a  <•  ].  Then 
the  smaller  is  ^ ,  the  larger  are  the  errors.  The  best  and  most 
natural  form  in  y  =  cT.  Then  the  change  of  per  sample  is 

proportional  to  the  symbol  interval  width.  The  initial  error  • 
must  he  0(/y),  for  otherwise  the  system  12.3)  will  not  be  able 
to  improve  the  estimate  for  small  y. 
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3a.  Remarks  on  weak  convergence  theory.  The  theory  of  weak  :or ■ 
vergence  of  a  sequence  of  nrohab i 1 i ty  measures  is  a  newe  rful  too! 
which  has  found  applications  in  many  areas  of  applied  probability 
j  v  [  w  J  ,  [  o  ]  .  Only  a  few  comments  will  he  made  here.  ’•>  *  • 
full  treatment,  see  [10  j.  Lot  1’  [  0 )  denote  the  state 
valued  functions  which  are  right  continuous  and  h<:\  e  left  hur 
limits.  The  piecewise  constant  process  U  (■  '■  can  be  treated 
as  an  ahs  tract  random  variable  with  values  in  DIO,*),  and  "  :  ’  luce  ■■ 
a  nrobabi  1  i t y  measure  P  on  it,  (actually  or  the  sets  of 
defined  by  a  certain  topology ,  called  t  b'-  Skorokhod  tepohmy  :  • 

this  need  not  concern  us  hero}.  The  sequence  ■  I’  '  (.  •  j  •  i  v  said  *  c 
be  tight  if  for  each  6  >  0,  there  is  a  compact  set  k.  i  I  ’ * 
such  that  P { LJ ^  C  -  )  £  K^}  >  1  -  6  for  each  ■■' .  The  sequence 
{!.!'(•)}  converges  weakly  to  a  process  U(  •  )  if  i.:  f  •  1  has  path® 
in  DfO,®)  and  induces  a  measure  P  on  it,  m. if  for  every 
bounded  and  continuous  real  valued  function  !■(•}  on  n[0,~), 

r  F  ( v)  dP  (v)  -  /  F(v)dP(v)  as  Y  0  .  If  1 U  !  (.  •  ) }  is  tight,  then 
each  subsequence  contains  a  further  subsequence  which  converges 
weakly  to  some  process  with  paths  in  Il[0,°°).  In  Section  ",  it  v  i  '  ' 
be  shown  that  for  our  problem  all  limits  arc  actual  ly  tie  same  ':au->- 
Markov  process.  The  limit  will  give  us  the  desired  information  about 


the  errors  and  dynamics  of  / U  }  for  small  '.  Weak  convergence  v 
a  substantial  generalization  of  convergence  in  distribution. 

Theorem  1  below  gives  criteria  for  tightness  and  we  a  'emergence  to  a 


specific  limit  which  are  readily  verifiable  for  our  problem 


in  terms  of  the  problem  data.  Despite  the  abstract  framework,  i 
techniques  are  readily  usable  on  problems  such  as  the  me  o  .*  Sec 
and  extensions,  and  the  method  of  proof  of  'ihcorem  2  illustrate 
relatively  straight  forward  way  in  which  the  abstract  Theorem 
often  be  applied. 

5b.  Remarks  on  t he Limit  theorem.  Let  B  { • .  1  denote  a  standard 

Wiener  process  (covariance  t )  and  x  ( • )  th«.  solution  to  t !  c 
stochastic  differential  equation 

(3.1)  dx  =  k(x,t)dt  +  v(x,t)dB, 


as 


0  for  a  suitably  large 


class  of  functions  f,  then,  un.'i 


some  subsidiarv  conditions  one  could  conclude  that  !'  '  <  ■ J 


weak  1  v .  Unfortunately,  (3.3j  is  hard  to  cet  an.: 


no  t  dm  1  c  i : 


our  case.  Kurt: 


showed  that  if  (3.3)  holds  w  ha  *  he  left 


f  is  "perturbed"  to  some  f  which  is  close  to  f, 


some  subsidiary  conditions  the  processes  will  converge  w.  d. 

Th  is  point  of  view  was  developed  and  s  imp  !  i  f  i  ed  in  1  >•  j  , 

we  use  the  form  developed  in  !  2  )  .  which  in  t  he  m  ~ :  con  von  .  ;  t  • 

purposes  of  this  paper. 

For  purely  technical  reasons  in  the  p  n*o  f  :  t  is  c<'r  vv-  c 1  ' 
bound  the  process  U  !  (.  • )  in  the  manner  given  below.  Th  i .  end.  1 
is  used  only  in  tiie  theorem  statement  and  u>  a  technical  i!e.  :  .  . 
in  the  proofs.  It  docs  not  affect  the  result.  ’  ,  ‘'nr  mid:  ' 
sequence  o:  bounded  processes  converges  weakly,  tb.en 
the  original  sequence  converges  as  desired.  Let  b  ^ ..  •  }  deno‘c  a 
continuous  function  which  is  zero  in  {x :  •  x '  >  \'  *  1  ,  man  1  '  o 
unity  in  { x  :  !  x  |  <  N  } ,  and  is  infinitely  d  i  fi\  rent  i  ah  1<’ .  ''erine 


<3.0  u*;*  -  uyn’K  -  [y<’n  +  A 


Y ,  N  X  \d,  , ,  , 

•„  P»-rV'Vl,» 


Here  \^//y  =  II  1  ’  ^  defines  The  sequence  ’  is 

n  n  n  n 

stopped  once  it  passes  N  +  !.  Let  he  the  piecewise 

y  N  , 

constant  process  wrhich  equals  U’’  on  the  intervals  [n  ,  ,  n,+  ,!. 

y 

fn  Theorem  1,  for  each  N,  A  stands  for  an  operator  ot  the  loin 

(3.2)  whose  coefficients  arc  continuous  and  cqc  :i  those  of  the 

■  N 

operator  A  in  the  set  {x:  j  x  |  <  N}.  The  exp  ions  I-T  ’ '  and 
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aY.N 


denote  (resp.)  expectation  conditioned  on  K 


Y’N  =  j 


'.N' 

4  i  '  i  -  l  ’  i  • 


n:  ana 


j  ti!C  ••conditional  average  difference"  operate; 


AY’Nf(nY)  =  [bY’Nf(nY+Y)  -  f(nY)]/Y. 


Theorem  1  is  an  adaptation  of  Theorems  2  and  3  of  [2]  to  ouv 
problem.  We  use  rJ  =  set  of  functions  of  (x,t)  with  compact 
support  and  whose  mixed  partial  derivatives  up  to  order  3  are 
cent inuous . 

3 c .  The  main  bac kground  theorem . 

The o=rpm_ J  •  Assume  the  conditions  on  the  coefficients  of  A‘  and 
A  g i von  above,  and  on  the  uniqueness  M  the  solution  of  (3.1).  For  each 
integer  N  and  €  31,  suppose  that  there  is  a  sequence  of 

random  functions  fY  ,N'(  • )  satisfying  the  following  conditions: 

is  constant  on  each  [ Yn , Yn  +  Y)  interval  and  depends  onl_v . on 

U "j  ’ ,V ,  i  <  n  ,  £, Y  ’ N  ,  j  <  n  ,  there  .  For  each  N  and  tQ  <  (  reca  1  I 

l^,Ni  =  UY’N(ny); 


(3.3) 


sup  F  j  f 
n ,  Y 


,,N(nY)j  sup  1: !  AY  ,fsfY  ’ (nY) 

n  ,  Y 


<  00  , 


n  V  < 


(3.6) 


E|  fY,N(nV)  -  f  (UY,N,nY)  |  ->  0 , 

F.|XY’‘V’N(nY)  -  (|y  +  AN)f(UY’N,nY)  j  -  0  as  y  *  0  , 

and  n Y  -v  t . 


a. 


Then  if  f  (T  ’ ^ { '  >  ,  >  >  0 } 


V  \ 

is  t  i  h  t  for  each  N ,  and  IJ  ’  ( 0 
converges  to  some  U  ( 0  )  in  d  i  s  t  r  i  hut  i on  as  'i  -  1  .  w c  h a v e 

U  i  '  )  x  -  )  weakly,  where  ,\  (  •  1  solves  (3 .  1  )  w_i  th,  \(ii 

The  sequence  t  >  0}  is  tight  for  each  V  i 

each  t  <  <*> , 

f(lP’N,ir-l'  •  -  -  n,  v act. 

ii  . 

(3.8)  1  ini  Tlni  P{  sup  |  AY  ’ N  f V  (nl )  !  >  K  =  0. 

K-wo  y>o  Yn<tfl 


(3.^1 


1  i : 
’>  ■* 


P ; 


sup 
n  <  t , 


in') 


4. _  The _ Limit  Theorem 

As  not',  d  in  Section  2,  the  magnitude  of  the  initial  errors 
"list  he  commensurate  with  the  gain  Y.  Otherwise  the  system  of 
figure  1  will  not  function  for  small  )  and  T.  for  simplicity 
assume  that  there  in  a  random  variable  l)^  such  that  i-0/  /T  -+•  !!., 
as  -  -*  0.  In  the  work  connected  with  {1,  figure  9.34],  i’  was 
implicitly  assumed  that  Uq  =  stady  state  solution  to  (4.1  •  :  ov: 


2  .  { IJ  1  ( •  ) }  converges  weakly  to  the  solution 


o f  the  Gauss -Markov  equation  (4.1)  ,  as_  v  --  9 


(4.1)  dU  =  -dUdt  +  vdB,  u(0)  =  U(). 

In  (4.1),  F.  ( •  )  i  s  a  standard  Wiener  process  and  (see  above  (2  . 4  i 
for  the  definitions  of  g  n ,  g  1  and  v  is  given  by 

v2  =  2f.fgn+1(0,0)  -  £(0,0)]  [gn(0,0)  -  g  CO  ,01  1 

+  f.[gn(0,0)  -  g(0,0)  r  »  .any  11  I  ^ 

1 

Note.  The  form  of  v“  is  similar  to  that  obtained  formally  by  the 
method  of  [1,  p.  445-447], 


Proof.  We  need  only  verify  the  conditions  of  Theorem  1  for 
the  process  (U^’^}  of  (3.4),  for  each  fixed  N.  The  proof  is 
relatively  straightforward.  The  systematic  way  in  which  the  (•) 

are  constructed  is  typical  of  the  method  in  other  problems.  Henceforth, 


the 

test  function  f  ( •  , 

,  • )  £  V  is 

fixed  (recall 

the 

de  f i n  i  t  i 

on  o  1 

'J 

given  above  Theorem 

1 )  and  for 

notational  convenience^  we 

om  i  t 

the 

superscript  N  on 

everyth  i  ng_ 

-  y  \ 

except  A  ’ ‘ 

and 

n 

f  Ul'i) 

l\  < 1  w  . 

get 

the  perturbed  test 

f  unct ion 

[''(•)  in  the 

f  o  rra 

t'(.U,,n>)  +  fpCnV'i  +  f^(nY)  +  f^(nY),  where  the  f.r  arc  to  be 
chosen  sequentially  such  that  the  conditions  of  Theorem  !  hold. 

-  r  N 

Start  by  applying  A  ’  to  t  : 


(J  .  .’1 


A’’Nf(tr,nn  =  >  f  t  (U  Y  ,  nY  1 


+  V  T 


+  o  (  v  )  -  >  f  ( 1! )  ,  n  >  t  v  f  i y  b 

u  n  ■  ■  \ 

f  (U’ ,n»)bv('jY)i:ir,NhYrA  . , a  ) 
u  n  ’  \  n  n  n  n  - 1  a 


uu' n"  '  i 


:  '  '  ' 


+  o 


In ' 


he  o] _  is  a  remainder  term  in  the  truncated  lavlor  expansion 


In 

satisfies 


(4.4  ; 


o\n  -  'n’N  0(Y5':(!tX-I’V  *  O) 


For  future  use,  note  that  (owing  to  the  properties  of  the  Wiener 
process)  for  each  tp  <  «> ,  and  N  >  0 , 

y 

1  im  sup  to.  /v  i  =  0  w  .  p  .  1  .  , 

^0  ny<t0  ln 

]  im  sup  F.|  oY  H  !  =  0  . 

Y-0  nY<i„  ln 


(4  .  S) 


introduced  below  also  satisfy  (_ 4 


A1_I 


kn 


i'p.  lv  the  first  and  third 

terms  on  the 

r  i  g!it 

■  ,  ;  4  . 

~  '  can 

he 

part 

of  an  operator  such  as 

l?/3t  +  AN). 

,  th 

1  he  t  am. 

.  th 

t  e  t 

PS  0 

;  J .  v 

1  depend  on  the  noise  4  ^ 

'  n - l ’  '  n  1  as 

we  1  1 

as  on 

(it'  .11!  ■ 
n  ' 

a  n 

ru-e  !  to  he  "averaged  out”.  Hie  perturbation  t'  is  chose' 

+ 

”ave  rare  out”  the  *'  term.  'define 

uu 


0 


(.n'r »  = 


f  (U  ,nY) 
uu  n 


bv(U  j 

\  n 


ih 


i  -n 


?  4  i  (  '  n  - 


f  (li'.ny) 
uu  n 


W' 


For  our  particular  problem,  due  to  the  truncation  effects  of  ,1.. 

’  *,  "  d  1  1/4  for  small  Y  and  the  signal  and  Wiener  pn-ce.-*--  components 

of  V  )  (for  j  >  n)  are  independent  of  >',*■,  j  1  n,  Lb,  j  s  n 

(bus,  the  sum  in  (4.6)  reduces  to  a  single  term.  The  general  (and 
more  complicated  than  needed)  summation  form  fn«-  f('  is  introduced 
here  only  because  it  is  the  appropriate  form  e  f  r  ’  ( n  r '  ror  the 
,'er.e  ra  1  i  cat  ions  of  Section  ,  am!  will  facilitate  the  discussion 
'here.  For  the  same  reason,  f|,f>  are  introduced  in  a  summation  form 
ho i aw  ,  even  though  for  the  problem  of  this  section,  the  sum  reduces 
to  a  single  tern. 


When  expectations  of  the  form  I  4  j  ( A  n  etc.,  arc  written,  we 


v 

mean  [  I.  4  j  ( X  ,  a  ) 


,  ;  i  .  o .  ,  the  A  ,,A  are  treated 

A  An . ! » A  \n  n  i  n 


as  parameters  and  considered  to  he  fixed  when  computing  the  expectation 


Also  4  .  (A  ,  ,  A  )  ,  j  >  n ,  is  defined  h  v  with  A 


1  rr  1 


.Vow,  applying  A  '  ’  ^  to  (^  (  n  >  ]  y  i  o  1 d s 


.  >  ,  v  f  (U  *  .  .n  v  +  ’tl 

i  A'-Nf,  in)  -  >[;'•'  .JHi— aji - 

0  n 


S'tVi1 


■  t(S  +  l(Xn’Xn  +  lir  '  ’  Un  +  1<  Wi 


(4. 


^  f  ( U  Y  ,  n  1 )  vV  v 

- HH — ^ - bv  (UY)  [nY  ’  N  (4  i  ,  ■*  ') 

2  N  n  n  n  J  - J  n 


r.(;  i \  i 

n  n  -  1  n 


on  the  right 

The  part  of  the  last  te  nn 'con  ta  i  n  i  tig  the  ! 


i>  N 


is  tlic  nee  at  ive 


of  the  next  to  the  last  term  of  (4.3).  Also, 


(4.8) 


yE({n(Xn-I’Xn))2  *  'X  A  >  2  *  °(1) 


For  future  use  note  that  for  each  t ^  >  0  and  i  =  0 , 


(4.9) 


1  im  sup  |  fY(nY) !  =  0  w.p.l,  lim  sup  F.|f|(i'))|  =  0. 
Y-*-0  nY< t  1  '' 


0 


Y  ‘0  nY<t0 


y  y 

f'quat  ion  (4.9)  will  also  hold  for  the  f  ^  ,  i  introduced  below. 

y  \ 

Replacing  U  J ,  and  v  .  .  by  II  and  '  ,  resp.  ,  in  the 
n+1  n+l  n  n 

first  term  of  (4.7)  alters  that  term  only  bv  a  quantity  o^n 
satisfying  (4.5).  In  fact,  ol  is  hounded  bv  (4.10).  All  the  o'! 
introduced  subsequently  satisfy  (4.5),  hut  explicit  bounds  will  in  t 
be  given. 


1 


With  U  , , a 

n+  1  ’  n+1 


0(lr)l:',N  /'  ,(\  .  1  '  'win- 2-.\  +  \  '-w(n+2 

v  n  n  + 1  n  n  +  1  n4  1 


replaced  by  in  the  first  term  of  (  l  .  ^ 1 


that  term  has  the  value  :cro,  due  to  the  independence  of  the  in¬ 
crements  of  the  Wiener  process  over  non-overlapping  time  i  ^  t  c  "va  1  «= 
Next,  we  turn  to  ”avc  rap  ing  out”  the  >/T  term  of  ( 4  .  v  .  T'h  i : 
will  be  done  in  two  steps.  be  fine 


>y)  -  A  fu(i’lb"»bs(u>l  ,]  vThvi'V 


Applying  to  f^(nY)  yields 


(4.11  '  r  A  ’  f  j'(nt)  =  -  fj'(nV)  + 


+  /y  !i  ’  bvfU’  .If  (11 '  .  ,nYH  ,>•  +  a 

n  N ■  n + 1  u  n  +  l  n+1  n  n+1 


where  the  ol  is  due  to  the  replacement  of  ni  +  )  hv  m.  1  he 
function  fj  satisfies  (-1.0).  The  first  term  of  '4.111  is  the 
negative  of  the  term  of  M  .  V]  .  The  middle  torn  of  (4.11)  will 

to  he  averaged  further. 
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The  middle  term  on  the  right  side  of  (.4.11)  can  be  expanded. 


lJ-‘-  A  :C, c-v' 


Y 


1 1  i  ^  i ■  i 


i  +  (j 

n+ 1  4n 


The  component  of  (4.  Id)  involving  if  b,.J  can  be  writ 1  en  a -• 

u  \  n 


(4.13)  t(f  ;u’  ,nY)b.,(UV))  IT  ’  "V  ,  (X  ,X  ,  UY(\  , 

u  n  Nv  n  Ju  n  n4- 1  n  ’  n+ 1  n  c  n  - 1  ’ 


)  ‘  pi 


r  f  f ,  (Uy,nY)bv(Li  h )  lf’’‘V  ,  (\  ,A  )  <,  '>  (\  ,  ,  >.  i  , 

u  tv  \  n  u  n  n+1  L  n  n  n  n  - 1  ’  n  : 


The  component  of  (1.12)  involving  (  f  !^.)  can  he  written  as 


■y  f,(aI,nrlbv(Ul)l:y<Nf.^1(Aii)AJ  ♦ 


u  "  n 


N  ■  n  hi  "if- 1  '■"'n  ’ '  n 


the  first  term  of  which  equals  zero  by  virtue  of  the  i  ndepcndcucc  of 
the  increments  of  the  Wiener  process  over  non -over lappi ng  tine 
intervals. 

Next,  define  f \  by 


CO  oo 

\  V 

L 


f?(nr»  =  XT  (Uy  ,nY)t\,(Uy) )  l  L  ...  . ,, 

2  uv  n’  ;  Nv  n"u  .‘:n  k=h+]  1  n  n*  n^  i v  n-1  ’  n 


7  h-(> 


i  “ ; 


4  .  14; 


i£/(A  ,A  k\>.  ltA|| 
k  n  n  i  n  -  1  n 


*  *  fii(,ln,ny)bN(Un) 


By  the  comment  above  (4.14),  the  second  sum  is  zero  (in  the  more 
general  cases  of  Section  5,  it  will  not  necossn  i  I  y  he  zero). 
Again,  by  the  independence  of  the  increments  of  w(-)  over  non¬ 
overlapping  time  intervals. 


2  0 


CN^VV-!‘Vl-V  *  «k<V'n*J<Vl-V-  (K 


t'or  i  >  n  +  1  and  also  for  i  =  n  if  k  >  n  +  1  fin  which  case 
both  sides  of  the  above  equations  equal  zero).  Thus  (4.14)  equals 


!  1.  is:  nfu<.n 'll^)  ’NV  ,  iVVsfVl  ■  •  'Cd'n'V'  vVrb 


It  can  be  shown  that 


>A  r  ’  Nf  ^  (nY )  =  -(4. 15)  +  o^  +  o  ( Y )  . 

One  component  of  (minus  (4.15:)  is  the  negative  of  the  principal 
part  of  (4.13),  the  other  component  is  the  "averaged"  centering  te 
\lso,  f 2  satisfies  (4.9). 

summarizing  the  above  calculations  and  recalling  that 


frln't)  =  f(U  ,ni)  +  £  f f  ( n  Y )  ,  for  each  t,  ■ 

n  i  =0 

lim  SUp  p|f^nY)‘  f(u\nY)!  =  0> 
Y-0  nT<t0 


,  N  < 


lim  sup  (  f!  (n'y)  -  f(U  ,nYJ  =  9  w.p.l. 

■w  .  _  -w  ^  J  1  * 


Y-*0  nY<t 


Also,  taking  advantage  of  the  cancellations  in  A!,‘  [ f ♦ f  \  +  f J  +  f ^ ] ,  we 


have 


a'-voiy). 


7 


r* i) + 1 e n * A „ n n e n . ,  n n )  *  »;  a 


(4.17) 


:i 


Changing  'n^n+l  to  zer0  t^ie  r side  of  (4.17)  alters  that 

NJ 

term  by  i'(vY).  Define  the  operator  A‘  hv 


3  ^  <  N  ^  , , ,  1  „ ,  i  _  r  5  .  N  n 
3t  A  ;l  (  n’n'^  f  3 1  ‘  ~  2 


Vv  (l,p  »  n  f y  ^ 

-N — " - L  +  kv(U  ,n>U-J  f(U  '  ,nl 

2  3  2  N  n  oir  n 


first  four  terms  on  right  of  (4.17),  but  with 


replaced  bv  0. 


Bv  the  properties  of  b  (•),  we  have  v"(u,t)  =  v“ ,  kv(u,t) 
when  iu  <  \ .  finally,  since  the  solution  of  (4.1'>  is  unique , 
all  the  conditions  of  Theorem  1  hold  and  the  proof  is  completed. 

q.  Fi.l). 


■>  *> 


5.  Extensions 


3 . 1  General  noise  and  intersymbol  interference.  Only  an  informal 
discussion  will  be  riven.  Kith  the  appropriate  scaling,  the  method 
is  similar  to  that  of  the  last  section.  l.et  s.j.(t)  +  v.j.(t)  denote 
the  input,  where  s^f  • )  =  input  signal,  v^i-)  =  stationarv  input 
noise  with  :ero  mean  value. 

Suppose  that  the  channel  memory  is  given  by  a  function  h..  (  •  )  • 

To  keep  the  system  from  degenerating  as  T  0,  we  use  h„.  (t)  1 
h(t/T)  for  some  transfer  function  h(-)-  for  notational  convenience 
assume  that  h(-)  ^  0  only  over  a  finite  interval;  in  particular 
let  h(t)  =  0  for  t  >  0  for  some  integer  Q.  Let  the  waveform 
transmitted  in  the  interval  (iT,iT  +  T)  have  the  form  s.q(t-i'i', 
where  q(u)  =  0  out  of  [0,1']  and  (s.)  is  a  stationary 
sequence.  Then 


sT(t ) 


T  •. 

i= [yl ~Q 


1  t-  i 

It  )  q  (  1  i  T )  d  t . 

0 


De  fine 


sT(t) 


• t  r  t/1 

s  (u)du,  S(t)  =  S  (t)/T  =  s  (vT)dv. 

o  -  n  1 


The  noise  model  is  based  on 
simplicity,  we  want  the  process 
(convenient,  but  not  essential), 
discussed  below  (2.3)  still  hold 


two  considerations.  first,  for 
(•)  to  have  onlv  a  finite  memory 
Second,  the  c  'nsidcrat ions 
here;  i . e . ,  we  want 


r  1  t  7 

var  v...  I  s'jds  -  o~  'i  -•  n 


for  some  o.  To  accomplish  these  aims 

r  t 


we  introduce  a  stationary  random  process  vi.  •  I.  tie  fine  '-it' 
assume  that  there  is  an  integer  K  such  that  for  eacn  fil, 

■  r  1  ,  s  v  t^;  is  independent  of  { V  f  s  I  ,  s  •  t  ()  +  R ,  and  -rt 

r  ,  i  t  \  r  I.  t  !  :  . 

The  finiteness  assumptions  connected  with  R ,  Q ,  Rua  r  : 


that  the  sums  defining 


f )  ’  ^  in  1'heorem  J  contain  onlv  a  ;  i  n  i  t  o 

l 


umber  of  terms  (with  the  signal  and  noise  ot  this  sub  sect  ion  used 


The  "tails"  of  these  sums  are  all  aero  by  the  tiniteness  and  in. 
dependence  as sumpt i ons . 


Next  ,  define  g  (A  ,  A  1  )  ,  g  (  A  , '  '  )  ,  IJ^  (a  ,  a  ’  ')  as  above  (2.-1) 
but  with  the  noise  and  signal  processes  of  this  subsection;  e  .  s:  .  , 
g^ (  \  ,  '  ’  !  has  the  representation 

g  (.',A'l  =  !  S (n+l+A+A  • )  -  S (n+A+A  )  +  'f  (n+  ]  +A  +  A  '  j  -  ■;  (n+A+ A  )  1 

-  1 S(n+2-A+\'l  -  S,'n+1 -A+A)  +  y  (n  +  2-d+A  1  t  -  f  (  n  +  1  1 

Again,  set  -  -  =  -=-  g’(A  ,  A  )  ;  ^ and  suppose  that  '■>  >  0,  for  othe 

the  system  (2.1:  will  be  unstable  for  small  i  >  0. 

We  will  not  go  into  the  details,  but  the  method  of  Theorem  2 
works  here  also.  Given  f  €  rj,  the  general  (finite)  summation 
forms  of  the  fi’^  are  used  to  get  the  perturbed  test  function 
f r  ’  ^  (recall  that  superscripts  N.'  were  usually  omitted  i  u 
Theorem  2).  We  need  to  verify  that  (4.9)  holds,  and  that  f 4 , S ) 

f  \ 

holds  for  the  o,  ’*  error  terms.  There  can  be  verified  under 

k  n 

reasonable  conditions  on  v(-l.  Assuming  this,  Theorem  2  holds 

hut  with  the  first  term  of  v“  replaced  by  (the  sum  contains  at 
most  ::tax(Q,R)  +  l  terms). 

00 

2  l  E4?  +  1  (0,0)£  1(0,0). 
k=  0  K  1  u 

5.2.  Random  clock  drift.  For  simplicity,  return  to  the  problem 
formulation  of  Sections  1  anJ  2,  but  suppose  that  the  transmitter 
clock  drifts.  In  particular,  let  the  signal  take  the  value 
s(t)  =  s^  on  tli’ci+])  rather  than  as  [iT,iT+Tl,  where 
t0  =  <5 0  >  tn+1  =  tn  +  T  +  5n+]-  where  ^  is  a  cro  mean  random 


J  4 


variable  such  that  <5  /  T  is  small.  Write  o'  =  l  <5 .  . 

n  0  i =0  1 

-  n  ^ 

=  nT  +  -  The  svstcm  is  riven  hv  Figure  !  ,  and  e  still 
n  0  -  -K  ’  n 

denotes  the  estimate  of  the  epoch  <5*!.  Set  -  fc  5n  1/T.  We 

1  0  n  -  n  i) J 

use  the  algorithm  (2.5),  (2.-1)  which  we  write  in  the  form 


'  1  ^ 
n  + 1  n 


?Wl/T’  tn/T) 


The  integrator  dumping  timing  is  still  given  by  *'  i  gure  J  hut  with 
the  current  definition  of  -t  }.  Figure  5  is  merely  a  translation 
of  Figure  2  into  the  " t  "  notation.  In 


part icular, note  that  (n+A)T 


+  •  ,  T  +  -  :  ,  a  n  d 

n  -  1  n  n 


(n+1  )’i 


-  ,  =  ( 1  -  A  )  T  +  .  T  +  i  -  o  . 

n  - 1  n  -  1  n  n 


Define  yn^n-x*vn)  :  en  (  ^  -  x /’r  *  /'r  as  in  -Section  J  . 

Referring  to  Figure  a,  note  that 


V'Vl-V  ■  l-'^n  *In.l/T  •{»M/T>-K(J*Vl*VT-Vn 


(5.:> 


*  W-4*VWT'l- 


gn(^>^')  is  defined  as  in  (5.2)  with  parameters  X,\'  replacing 
Xn-l’Xn’  resP-  Let  g(*-»*')  =  bgn(X,A>).  Next  rewrite  (5.1)  as 


(5.3) 


*  .  X 


n  -  6n+l/T  * 


Define  inn/T/i  ^  /y  Define  ^  (X  ,X  ’ )  ,  u*  and  uV)  as 


above  <  2 .  4  i  ,  but  using  the  p  oi‘  (5.2). 
and  assume  that  '•  0.  As  in  Sections  2 
partially  linearized  system,  which  is 


-et 


“7^  1 

J  »■  ' 


4,  u e  work  with  the 


.  4 


AH 


1  ’  A  n  ' 


'■  ”•  tact,  the  "linearization  errors"  go  to  zero  on  anv  tiu.'e 
i  rstc  rv  a  '  •  n  :  n  ■  •  r  , ,  a  s  ■  ■  “  . 

lor  the  sake  of  simplicity,  let  there  he  an  \  ,  net  lop  end  i  n . 
on  !'  or  •  such  that  'T  ,  >  •  *  n.  is  i  nd ependent  of 

'  n  *  N  ,  for  each  r. .  T : , ; i used  <>n  !  v  to  assure  *’  •>  r 

1  ;  I 

the  sums  f .  ’  ^  dr  lined  i '•  Then  re4'.  .1  have  a  finite  number  of  non 
zero  terms .  Use,  suppose  t  hat  .  .  •  is  ;  lu'enendent  of  w  • 

i 

(those-  assumptions  arc  not  neeessan  .  hut  simplify  the  discussion 

In  order  to  effect  i  voly  track  changes  in  the  timing,  the  dr  i  ''t  tei-  > 

{  •'  '  must  be  "of  the  order  o  I’  >  "  I  loose  lv  speaking  1  .  In  particular, 
n  ' 

r  )  . 

we  assume  that  hd  is  stationary,  with  a  covariance  not  depending 
on  i  . 

The  method  of  Theorem  2  can  now  he  applied  and  the  limit 
process  is 


dd  =  -  1 (J  J '  +  VjdP, 


where  (v"  is  tie  fined  in  theorem  2) 


{  5  .  h  J 


+ 


oo 


The  added  term  in  (3.bj  is  due  to  the  { J  '  ;  clock  drift  process. 
Y 

If  {Y  }  were  not  independent  of  w(*',  then  there  would  he  an 
additional  "cross"  term  in  (5.0)  . 
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ABSTRACT 


Communication  systems  often  involve  differential  eauations 
models  whose  inputs  are  noises  and  signals  with  wide  bandwitlths . 

It  is  freouently  of  interest  to  approximate  them  by  some 
Markov-dif fusion  process,  since  then  many  analytical  and  numer¬ 
ical  methods  can  be  used.  Here,  recent  results  on  getting  diffu¬ 
sion  approximations  to  systems  with  such  inputs  are  applied  to 
three  classes  of  detection  systems  which  are  very  important  in 
applications :  '!■)•  A  phase  locked  loop  with  a  limiter;  (  J  '  i 
quadr icorrelator  with  and  without  a  limiter  (the  function  is  to 
track  changes  in  phase  and  frequency)  ;  3  )  a  1 souaring1  loop, 

whose  purpose  i  s  the  tracking  of  the  carrier  frenuency,  despite 
the  carrier  modulation.  in  (31,  a  type  of  pulse  phase  modulation 
is  used.  The  method  is  natural,  systematic  and  relatively  straight¬ 
forward.  Under  natural  scalings  of  the  signals  and  noises,  the  ap¬ 
propriate  diffusion  approximations  (for  band-pass,  but  wide-band 
noise)  are  obtained.  The  approximation  is  in  the  sense  of  weak 
convergence.  The  first  two  problems  have  been  hard  to  analyze 
owing  to  the  nature  of  the  non-linearity,  and  the  results  clearly 
indicate  the  advantage  and  disadvantages  of  the  use  of  the  limiter. 
The  third  problem  has  been  difficult  to  analyze,  partly  due  to  the? 
periodicities  which  occur  naturally  in  such  problems.  All  three 
classes  represent  widely  used  and  important  systems,  and  much  in¬ 
formation  can  be  obtained  from  the  limit  process.  lor  example, 
the  results  show  that  the  use  of  a  limiter  can  actually  improve 
the  tracking  ability  of  the  systems,  when  the  noise  is  small.  The 


system  signal  and  noise  models  to  which  the  methods  can  be  applied 
is  much  broader  than  those  used  here.  But  the  results,  together 
with  the  results  in  [4]  for  different  classes  of  problems,  illu¬ 
strate  the  great  potential  of  the  approximation  methods  for  prob¬ 
lems  in  control  and  communication  theory.  In  certain  cases,  the 
limit  processes  are  of  the  type  which  have  been  obtained  via  more 
formal  arguments. 


I. 


Introduction 


Diffusion  approximations  to  the  output  and  state  variable 
processes  for  several  types  of  phase  locked  loops  (PLL) ,  Costas 
loops,  and  related  systems  are  obtained  when  the  input  noise  is 
'bandpass, '  but  with  a  wide  bandwidth.  The  systems  are  commonly 
used  to  estimate  and  track  the  phase  and  frequency  of  received 
signals  (with  additive  noise) .  There  is  a  vast  communication 
theory  literature  on  the  subject,  and  there  are  very  many  useful 
methods  for  the  analysis  of  such  systems  [l)-[3].  Yet,  it  is 
only  recently  that  rigorous  methods  for  getting  the  diffusion 
approximations  for  more  complicated  and  non-linear  systems  have 
become  available.  We  will  use  one  such  method  here. 

Three  important  cases  are  of  particular  interest  where,  owing 
to  the  nature  of  the  non-linearity  or  other  system  feature,  the 
analysis  has  been  difficult.  In  the  first  two  cases,  the  system  con¬ 
tains  limiters  (Figure  lb) ,  a  frequently  used  type  of  non-linearity. 

Markov-dif fusion  approximations  to  the  output  and  state  pro¬ 
cesses  of  non-linear  systems  with  wideband  inputs  are  a  major 
concern  in  communication  (and  control)  theory  because  a  large 
number  of  analytical  and  numerical  techniques  can  be  used  on  the 
approximat i on .  The  original  system  is  often  too  complicated  for 
much  insight  into  its  properties  to  be  obtained  otherwise.  The 
fact  that  the  bandwidth  of  the  input  process  is  often  wide  allows 
diffusion  approximation  or  averaging  methods  to  be  fruitfully  used 
to  get  the  approximations. 

Reference  f 4 ]  illustrated  the  application  of  the  general 


[ 


L 


method  of  [5]  to  get  diffusion  approximations  for  several  standard 
problems  in  communication  theory.  Using  a  related  result,  the  in¬ 
vestigation  is  continued  here  on  the  different  (and  perhaps  harder) 
problems  cited  above.  Reference  [6]  extends  the  result  in  [51  and 
provides  a  simpler  proof  under  simpler  conditions;  but  from  the 
point  of  view  of  applications,  the  theorems  of  (5]  and  [  6  i  arc- 
used  in  exactly  the  same  way.  Here  we  use  the  theorem  in  lb] ,  be¬ 
cause  the  conditions  are  simpler.  In  Section  II,  the  main  back¬ 
ground  theorem  is  stated.  The  basic  idea  is  that  the  original 

fc. 

system  state,  x  (•) ,  is  parameterized  by  t,  and  as  t  -  0,  the  in¬ 
put  noise  bandwidth  (BW)  goes  to  ■*> .  Under  reasonable  conditions, 
the  basic  background  theorem  allows  us  to  conclude  that  x"(»)  con¬ 
verges  weakly  to  a  particular  diffusion  process  x(*)-  Section  III 
deals  with  the  basic  phase  locked  loop,  with  and  without  a  limiter. 
Section  IV  treats  a  form  of  guadri  cone1  ntnr  with  no  limiter,  and 
the  limiter  is  added  in  Section  V.  (This  system  is  a  more  sophisti¬ 
cated  form  of  phase  locked  loop.  It  is  used  to  track  when  the 
freauency  errors  are  larger.)  in  Section  VI,  we  treat  a  "squaring 
loop"  whose  purpose  is  to  accurately  track  changes  in  the  carrier 
frequency  in  presence  of  modulation,  and  we  investigate  the  effects 
of  the  carrier  modulation  on  the  tracking  errors  when  the  noise  in¬ 
tensity  is  small.  Despite  the  mathematical  nature  of  Section  II, 
the  basic  results  can  often  be  used  in  a  relatively  straightforward 
way . 

Owing  to  the  differences  in  the  problems  treated  here  and  in 


[4],  and  in  the  types  of  noise  used,  many  of  the  details  are 
different.  We  concentrate  on  the  differences,  building  on  the 
results  in  [4]  where  possible,  but  often  omitting  details  wher 
they  are  similar  to  those  in  [4]. 
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II.  Mathematical  Background 

We  suppose  that  the  reader  is  familiar  with  the  weak  con¬ 
vergence  terms  and  ideas  as  used,  for  example  in  [4],  Section  2. 

»  L  t  i.  L 

Formally,  suppose  that  the  system  is  given  by  x  =  H  (n  ,x  ), 
where  n"  is  an  input  noise  process  whose  BW  *  •"  as  ■■  >  0.  We 
are  interested  in  showing  that  x ^  ( • )  converges  weakly  to  some 
diffusion  x ( * ) 


dx  =  u (x)dt  +  o(x)dw. 


(2.1) 


1  2 

with  differential  generator  A  =  -  u.(x)l/2x.  +  2  a..(x).'  /^x.ix. 

i  1  1  2  i,j  -‘3 

where  a(x)  =  (a_(x)}  =  c(x)o'(x).  Define  the  truncated  process 


>,N 


(  • )  by  x 


t  ,N 


=  H  (n  ,x 


^  /  N , 


V* 


,  where  b  (x)  =  1  for 


N 


<-  N 


and  equals  zero  for 


,N 


N  +  1.  Let  A  be  the  differential  gener- 


N  N  N 

ator  of  a  diffusion  process  x  (♦)  with  coefficients  a  (•),:  (•)  eoual 
to  a  (  • )  ,  and  c  (  • )  in  {x :  |  x  |  <_  N }  .  If  [6]  { x  ' N  (  • )  )  ■*  xN  (  • )  weakly 

for  each  N,  then  {x^(*)l  -»  x(*)  weakly.  The  truncation  is  used 
because  it  is  easier  to  work  with  bounded  processes  in  thr'  ^rrnr  of 
the  background  theorem.  It  is  a  technical  device,  not  an  assumption 
cm  the  original  problem  data.  Next,  we  define  some  terms  and  then 
state  the  basic  background  theorem  which  is  to  be  applied  in  the 


seouel . 


•)  is  assumed  to  be  continuously  differentiable. 


Let  denote  the  space  of  real  valued  continuous  functions  on 

IT  '  P 

R  with  compact  support  and  £  '  '  the  subspace  of  functions  in  (•  . 

0  1 

whose  mixed  a  partial  t-der ivatives  and  f  partial  x-der ivatives  are 

Let  { 9 L 1  be  a  non-decreasing  sequence  of  o-algebras 
t 


continuous . 


5 


with  measuring  -.'n  (s)  ,  s  <_  t1.  Let  d#  denote  the  class  of  real 

valued  (progressively)  measured  (~,t)  functions  such  that  if  « ( • j  & , 

then  sup  E:git)  <  >  ,  E'g(t  +  c)  -  g(t)  •  0  as  6  .  0,  and  g(tj 
t  c 

depends  only  on  nc(s),  s  <_  t’.  Let  i;  denote  expectation  con- 

t 

dxtioned  on  We  say  p-lim  f  (•)  =  0  if  sup  E  f  1  (t)  ■  and  foi 

t  6  ->•  0  :->0 

t>0  .  t 

each  t,  e  !  f  ( t )  !  -  0  as  f  >•  0.  Define  the  operator  a'  with  domain 

£/?(A  )  as  follows:  gt  £^(A“)  and  A“g(*)  =  o(»)  iff  g(-)  and  n(*)  are 
E.g  (  •  +  c)  -  g  (  • ) 

in  and  p-lim  [ - -  q(*)l  -  0.  So,  A"  is  a  type  of 

'  -0 

infinitesimal  operator.  The  following  theorem  is  a  special  case 
that  in  [6] .  A  more  complicated  form  was  used  in  [4] . 

Theorem  1 .  Let  (2.1)  have  a  unique  solution  in  the  sense 

that  any  two  solutions  induce  the  same  measure  on  the  usual  space 

,  \2  3 

of  continuous  functions .  F ix  N .  For  each  f  (  • )  <-  £  '  let  _/ 

_ be  a  sequence  { f  ° ' N ( • )  >  t &  such  that 

p-lim  j f  (•)  -  f(x  (•)#•)-  0 
E--0 

p-lim  jAe-f^'N(,)  -  (AN  +  f  (x',N  (•),•)  1  =  0  . 

£-»•  0 

Then  ,  i_f  !  x  L  ' N  ( • )  }  is  tight  for  each  N ,  '  x  L  (  • )  )  ■  converges  weakly 

to  x  (  • )  as  >  0 . 

Note.  Tightness  is  often  not  hard  to  prove.  For  our  case  ‘he 

i  ,  N 

method  of  [7j  as  adapted  in  [6]  can  easily  be  used.  The  !  (•) 1 
are  found  by  essentially  the  same  method  as  used  an  [4],  [r>],  [6], 


6 


and  [7].  We  use  the  form  £*'^(t)  =  f(xL,N(t),t)  + 


i= 0  or  1 


where  the  f  "''*<•)  will  be  defined  in  the  following  sections.  Hence¬ 
forth,  in  order  to  minimize  notation  and  detail,  the  N  and  bN  will 
be  dropped,  and  where  needed  we  simply  assume  that  the  processes 


x  ( • )  are  bounded  (as  they  are  because  we  work  with  the  truncation 


^(•1) 


Phase  Locked  Loops  with  a  Limiter 


The  system  is  described  in  Figure  1.  First  (Section  III.l) 
we  work  with  the  smooth  approximation  ga(-  )  to  the  ideal  limiter 
See  Figure  la.  We  get  the  diffusion  process  limit  x(-) 
of  the  sequence  (x  £(  • )  }  =  (v  £(  • )  ,  «  £(  • )  }  as  t.  -  0  ,  then  *  *  0  . 
The  derivative  of  g  ^  ( - )  is  assumed  bound od  by  some  K/u  and  the 
filter  in  Figure  1  is  simply  the  state  variable  representation  of 
an  arbitrary  low  pass  filter.  In  Section  III. 2,  we  work  with  the 
hard  limiter  g(-)  of  Figure  lb  directly.  The  limit  diffusion  is 

the  same  in  both  cases,  and  we  develop  the  result  for  both  cases 
in  order  to  illustrate  the  robustness  of  the  performance  of  the 
system  of  Figure  1  to  mild  changes  in  the  non-linearity.  This 
robustness  is  clearly  necessary  for  a  practical  system. 

In  analyses  of  PLL's  (even  without  limiters)  it  is  usually 
supposed  that  the  input  noise  is  wide-hand  [P]  and  the  limits  sought 
(explicitly  or  implicitly)  as  the  BW  Tt  is  possible  for  both 

An  and  d ^  to  depend  on  time,  and  the  signal  might  then  consist  of 

E. 

the  variations  in  d  or  A q.  But  for  our  calculations  in  this  sec¬ 

tion,  AQ  is  held  fixed  and  d  (•)  =  t)  ( • )  ,  a  differentiable  function. 
If  a  more  general  d(«)  were  used  (say  a  right-continous  Markov 
process),  then  the  infinitesimal  operator  of  that  process  would 
play  the  role  that  the  differential  operator  plays  in  the  sequel. 

The  result  is  the  same.  We  are  interested  in  the  problem  for  large 
input  noise  and  signal  BW,  say  of  the  order  0(l/qp,  where  q  0 
as  e  -v  0 .  Thus  the  center  frequency  must  tend  to  as  <-  -*■  0 . 


s 


t  z 

"e  use  "q  -  ^q/6-  ,  £/qt  +  0  as  ^  +  0,  so  that  the  center  freouenev  is 

large  relative  to  the  bandwidth,  as  in  practical  systems.  This 
scaling  is  appropriate  for  the  problem  and  consistent  with  heuristic 

methods  for  analyzing  such  systems.  The  gain  I.L  =  L/q  is  needed, 
either  before  or  just  after  the  filter,  because  otherwise  the  input 
to  the  VCO  will  go  to  zero  as  e  -  0  owing  to  the  effects  of  the 
wide -band  input  noise  [ 4  J . 

We  next  describe  the  noise  model.  The  noise  model  is  a 
standard  one  for  band  limited  noise  and  is  suitably  scaled  for  our 
method.  We  suppose  that  the  noise  is  Gaussian,  although  this  is 
not  always  necessary  and  the  modification  of  the  result  for  non- 
Gaussian  noise  will  be  stated  when  available.  Let  :.(•),  i  =  1,2, 
denote  independent  real-valued  stationary  continuous  Gaussian 
processes  with  unit  variance  and  a  correlation  function  g  (  •  1 
which  decreases  to  zero  at  an  exponential  rate.  Let  .  ,  i  -  1,2 
be  random  variables,  uniformly  distributed  on  f  0 , 2  ^  J  and  such 

that  (z^(-),  » ^ ,  i  =  1,2}  are  mutually  independent.  Write 

1 

z.(t)  =  z  •  ( t  /  q  “. )  and  define  the  noise 

L  it' 

nc(t)  =  [Zj  (t)cos  O^t+dj)  +  z^(t)sin(w(l;t+'})^)  ]o/qt.  (3.1) 

Tf  Sfw)  is  the  spectral  densitv  of  z.(*j,  then  the 
c  2  t  1  t 

spectral  density  of  n  (•)  is  S  (q  ^  (**>-u>0) )  +  S  (q  £  )  ) .  The  choice 

of  wi  ,  e,  q^  in  any  particular  problem  is  determined  by  the  problem 
X  ‘  ' 

The  VCO  (voltage  controlled  oscillator)  is  an  oscilllator  whose 
frequency  deviation  from  a  'central'  frequency  is  proportional  to 
the  input  signal. 


MWiil  Mk 


lata  and  will  he  commented  on  below. 


i;or  simplicity  we  set  !.=  kyl. 

Their  values  can  be  incorporated  into  C.  i  sec  lie.  1). 

he  nou  make  some  simp  1 i cat i ons .  First,  we  note  that  the 
center  noise  frequency  can  he  changed  to  any  w  ^  such  that 

q  I  "•  'd  as  e  -  0,  without  altering  the  results.  Next,  we 

drop  the  from  fa. 1) -For  notationa!  simplicity.  This  does  not 

alter  the  result-.  Also,  >or  nut  itional  simplicity  we  specialirc 


the  noise  to  the  following  (iauss 
d I  -  =  A.I.dt  +  B . dw  ,  where  w (  -  T 

-*■  I  1  1 


Markov  case  t  it)  =  C  7.  ( t  ]  , 
is  a  standard  Wiener  process  and 


the  roots  of  \j  are  in  the  open  left  hand  plane.  I: L  denotes 
conditioning  on  ■‘Z,'(s),  s  s  t  •  ,  where  Z(t>  =  {  2 .  ( t )  ,  Z  ,  ( t  !  1  and 
Z  (  1 1  =  Z it/q"). 


Assuming  tfof  the  moment)  that  the  multiplier  device  does 
nothing  but  multiply,  its  output  is 


~-[c3  (t)  (cos 


e  fc  +  cos  (2^^t  +  d  *")  )  +  z^(t)  (sin(-d  t) 


+  s  in  ( “,JJg  t  ♦  3fc)J  +  [sin  (d  4  s  i  n  (u  Sd  fc  +  2wjjt )  ] 


In  analyzing  systems  with  practical  rather  than  with  ideal  multipliers, 

it  is  common  practice  to  assume  that  the  multiplier  has  a  "low  pass 

filter"  incorporated  within  it,  and  to  drop  the  terms  in  ( 3.2) 

e 

containing  2w^t.  We  make  this  assumption  also. 

We  want  to  retain  a  structure  which  allows  the  signal  BW  to  he 
nO/qt).  In  fact,  a  filter  would  often  he  used  before  the  multiplier 
to  limit  the  input  noise  BW  to  that  of  the  signal.  Thus,  for  the 
moment,  suppose  that  there  is  a  filter  in  the  multiplier  with  cutoff 


•>  c 

frequency  0(l/q"l  “^O'  ' n  t^c  theoretical  analysis  [see  Section 

'  c  .  t 

II),  the  true  '•>  ,  v  are  actually  multiplied  by  ( •  )  and  limits 
taken  as  V  *  v,  th£n  »  0.  Thus,  in  the  analysis,  the  derivatives 
are  bounded  uniformly  in  t ,  for  each  This  fact  can  be  used  to 

show  that  the  terms  in  (3.2)  containing  3 ^ ^ t  have  no  effect  in  the 
limit.  But  it  is  easier  to  simple  make  the  assumption  in  the  sen 
truce  below  (3.21.  All  other  filtering  actions  are  incorporated 
explicitly  into  the  filter  box  in  figure  1. 

The  input  level  A(1  can  either  be  constant  or  time  carving.  Vie 
suppose  for  convenience  that  it  is  constant,  and  note  the  following 
for  the  time  varying  case.  let  A  j ( *  )  denote  a  hounded  process  with 
mean  TA^ft)  =  A().  (If  the  mean  value  A()  is  periodic  rather  than  a 
constant,  use  the  arithmetic  mean  over  the  period  instead  of  the 
mean  value.)  Suppose  that  the  input  modulation  has  the  form 

i  > 

An(tl  =  A1(t/q“)  (bandwidth  Oil/q“).  Then,  loosely  speaking,  if 
A j ( • )  is  sufficiently  strongly  mixing,  the  limit  results  are  the 
same  as  for  the  constant  V,  case,  but  where  An  replaces  A  in  the  limit 
formulas.  The  calculations  required  for  the  proof  use  a  combination 
of  tho  ideas  of  this  section  and  of  Section  VI,  where  we  consider 
t he  effect  ol  variations  in  A  ,  ( • )  on  tho  errors  in  carrier  (requeue 
tracking,  when  a  "squaring  loop"  is  used. 

The  main  result  is  the  following.  As  e  >  p  ,  (  v 1  ( ■  )  ,d  *”  (  •  )  } 
converges  weakly  to  the  diffusion  process  v(-), '-'(•)  given  bv 

■  U 

T.e.,  the  conditional  distributions  of  A.(t),  A.(t+s)  given 
1  A , (ul u  <  0)  converge  fast  enough  to  the  1 uncondT t ional  distri- 
bui  i  ons  as  t  ,  t  +s  ►  <*> . 
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dv  =  [Dv  +  -y  n/1  sin  (o  -  5 )  Jdt  +  H  oQdB 
dJ  =  Cvdt  ,  P  given. 


(  3.3) 


where 


1 


B ( • )  is  a  standard  Wiener 

r* 

4  :  [p{z.(u)  ••  o,  z.i o )  >  (>) 
j  o  1  1 


p  r  o  c  e  s  s  a  n  d 
-  P{ziCu)  <  0.  0 ) 


4 

"n 


sin  ►'  ( u  )  du 

j  0 


0  i  ]  du 


(3.4) 


where  c  (  •  '  is  t  iie  normalized  (such  that  >  (.  ( •  > 
function  of  j  1  • )  .  If  >  (t  I  =  exp  -a  t1,  a  d, 
can  he  evaluated  and  o“  =  2  In  2/a  1.4  |,  Section 
For  the  system  without  a  limiter  (and  l./q 
a  unity  gain),  the  limiting  process  is  defined  by 


1  c  o i re  1  a t i on 
then  tin  integral 

0 . 


=  I  replaced  hv 

L 


dv  =  [Dv  +  H  -J-  sin  (d  -  § )  Jdt  +  o^ldB, 
d®  =  Cvdt, 


(3.5) 


1  4- 

where  ct  -  —  !  P(u)du. 

1  “  J  0 

Note  the  "l/o"  effect  in  (3.3).  For  small  e,  the  system 
with  the  limiter  is  preferable  to  the  system  without  the  limiter. 

The  result  (3.5)  remains  true  for  non-Gauss  i  an  noise.  1'he  1  /c  effect 
has  been  demonstrated  by  simulations  on  systems  similar  to  those  of 
this  section.  These  simulations  suggest  that  the  limit  results  are 
often  ’worst  case’,  in  that,  for  small  *-  %  0 ,  the  actual  s  vs  tom 
often  performs  hotter  than  indicated  hv  the  limit  results.  In 
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particular,  if  the  limit  results  indicate  that  the  limiter  improves 

the  operation,  then  the  performance  might  he  even  better  with  the 

actual  system,  if  the  effective  value  of  t-  is  small.  An  equation 

of  the  form  of  (3.3)  can  also  he  obtained  for  non  -  bans s i an  process, 

■> 

under  suitable  conditions  on  the  z.(-).  ihen  c>“  will  b*.  given 
by  the  top  line  of  (3.4),  but  the  ~  1 n  (3.3)  will  be  replaced  by 

a  different  constant. 

Comment  on  the  choice  or  «»  ,  ,a, "  in  a  particular  n  ract  c  al 

probl  em .  for  the  limit  results  (3.3)  with  t(t)  =  exp  ~  a  t1,  Coth 
c  and  a  are  needed.  Fven  without  knowledge  of  these  values.  l'.3' 
gives  the  nrimarv  qualitative  properties.  Mso,  since  the  gain  !.r 
l/u  was  used,  it  was  implicitly  assumed  that  u  was  known.  This 

b  L 

is  not  necessary.  We  can  estimate  a/q“,  c“/q~  and  o~/2n  from 

the  data  (from  the  normalized  correlation  function,  the  variance,  and 

the  power  density  at  center  f requenev)  .  l.et  l.t  =  (/e-'q  :  1  */a/  ’ 

/a/qr  ,  a  uuantity  which  can  he  estimated.  Ihen  the  1/c  and  M  of 

( 3 . 3 '  are  replaced  by  /a /o  and  *2  In  2  resp.  Thus,  prior  knowledge 

of  q  a  or  a  is  not  needed.  This  is  the  case  for  all  the  problems 

which  we  have  examined.  For  the  case  where  the  u  -  (  *  1  arc  Cans'- i. an 

but  with  correlation  function  p ( •  )  going  to  zero  exponentially,  the 

r°°  -  1 

21  nd/a  is  replaced  hv  f  4  /  a  J  !  sin  eltldt  N,  Section  <>  |  .  The 

/  0 

spectral  density  of  the  noise  (near  the  center  frequency)  after  the 

-oo 

’  .  ] 

limiter  is  approximately  q“(-1/7!)  sin  i  (t)dt,  a  quantity  which 

L  '  >  0 

can  he  estimated.  If  we  let  I.  be  proportional  to  the  inverse  of 
the  square  root  of  this  quantity,  the  "l/o  effect"  noted  in  (3.>)  is 


ma i nt  a i ned . 


III.l.  The  Smooth  Limiter  £  1 • ) 


\ow,  we  restrict  attention  to  use  oi  the  smooth  limiter  ga  (  ’  ) 

and  s;  e  t  the  !  i  m  .  t  s  as  •-  *  •>  and  -  •  !'  ■  When  *  0,  *  *  0  '  "  "t;,u‘d’ 
;e  mean  that  t-oth  a  and  •-  •  hut  in  such  a  wav  that  <\  J  *  •  K  tor 

t 

.  a  .  r:!  is  condition  can  he  weakened..  Mumping  the 


we 

s  one 


-hi1 


components  of  (5.2),  the  input  to  the  filter  is  ipM  t ,  ■>*'<  t  i ,  :i t  )  > ,  where 


e  .  n  e  1  r  o  ,  c.  “t 

Ua(t,0  ,V)  =  —  ga[^  (Zj  (t)C0S  J 


i  ( t }  s  i  n  j  C )  +  -y  s  i  n  ( .  '•>  $  1 )  ] 


and 


vc  =  Dv*'  +  Htu^  +  H(ut  •  F.u^) 


'  t  _  t 

e  =  Cv  > 


where  the  expectation  F.  is  over  the  z^(t)  only  and 

I:.u^(t,0L,&)  =  yf  ~  sin(0  -0t')  +  0(qLu)/qL  . 

Now,  Iheorem  1  will  be  applied.  (liven  the  test  function 
f  (  •  J  6  5a.  we  must  find  a  sequence  of  perturbed  test  functions 
(f  ■(•)}  satisfying  the  conditions  of  Theorem  1.  (Recall,  we  drop 
N  and  h..  in  our  calculations,  for  notational  convenience.)  The 
averaging  method  ami  the  technique  of  proof  is  the  same  as  that  used 
in  [4]  and  |P|  and  very  close  to  that  in  |8].  Where  the  details 
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overlap  those  in  [4]  or  [6]  only  a  sketch  will  be  given.  For  given 
f f • ) ,  we  use  f  of  the  form  noted  below  Theorem  1. 

For  £  ES  (write  xb  =  x^tj),  we  start  by  applying  A* 

to  f  (x  °  i  .  In  this  case  the  A*-  operation  is  merely  a  right 

derivative 


=  l't  ,t )  +  fy  (.\>,t)Cv>  '5.6.) 

+  f  ’  ( .  t )  [ih,l  +  ii  t  t:uL  1 1 L ,-j  ( t  j  1  +  hi  ub(  t  ,0 L  ,e  ( t  n 

\  Ul  IX 

-  i:(U^(t  ,5 L,j(t)))  ]  • 


Only  the  "noise  term",  f  *r  (x  t,  t  )H  ( -  I'u^J,  of  (5.6)  needs  to  ho 
averaged  out.  The  other  terms  are  part  of  or  close  to  components 
of  (yjr  +  A)f(x\t),  where  A  is  the  operator  of  (5.5)  •  I'etino 
the  first  perturbation  f^(t)  =  fjix  (t),t!,  where 

»  -C 

f^(x~,t)  =  •  dst^ f ’ (xc , t  +  s )H [uL (t +  s , 5 L 1 1 >  ,o  ( t ) )  - 

1  j  n  *  V 


-  1:11  ^  (t+S  ,6  b(t)  ,t>  (t)  ))  ]  . 


Note  that  the  integrand  at  s  =  0  is  just  the  "noise"  term  of  (5.6) 
In  all  expressions  of  the  type  I  u^(  t  +  s  ‘  i  t  )  ,u  (  t )  )  (or  with 

replac  ing  1.),  the  expectation  is  over  the  a’ (t+s)  only,  not  over 

''  L  L  .  1 

'■>  (t)  err  x  (t).  Via  the  change  ol  variables  s/<|“  s,  (5.  "I  can  be 


written  a s 
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o2  Jsi  ‘'6’  i  x  t ,  t  +q“s  J  If  |  (  t  +  q“s  ,  <•<  (  t  !  ,  ^  (  t  )  J 

' ;  i  o  '  v 


1  iT  it  +i|7s  ,  i  t  ),■-■(  t  ) )  I 


which  is  bounded  in  absolute  value  by 


1  q c )  I  i  +  I  z  I  t/q“  j ;  I 


3 . 8  i 


[See  [10]  for  a  related  calculation;  here  itc  use  a  different  noise 
model  than  in  !  1  a  |  ,  and  n  multiplier  rather  than  an  adder.  lliese 
require  somewhat  different  details  and  yield  results  which  are  not 
directly  deducible  from  the  results  of  |]0j.)  It  can  be  checked 
that  f^(-)  6  ^(Ab)  and  that  (write  x^ft)  =  x;  the  tern  denoted 
simply  by  the  bracket  {  }  is  the  integrand  in  (3.7)),  and  the  sub¬ 
scripts  3,  oand  v  still  denote  the  partial  derivatives  or  gradient) 


A  fr;  1 1 )  = 


f  \  (xL  ,  t)  H  ( u*"  ( t  ,u  L  ,o  f  1 1  )  -  I  ii  J  1  •  -  i  'J  1 1 '  1 


■  1  dshW 
-  0  t 


t)  +  dsl-i^l  1.,  -'  (t 


0 


(  3  .  9  ) 


dsb.S 

1  t 


1  ’  v  L  ( t  1 

1  V  k 


The  first  term  of  (3.9)  is  the  negative  of  the  "noise  term"  of  ‘ 


Sow,  examine  the  second  term  of  (3.9),  which  we  write  in 
greater  detail  as  (see  below  (3.  lit)  fur  t  ho  detimtio'  ;  of  the  new  terms 
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1 

b  ;0dsf^(xt*t+sJ,I(EtRa[t+sl  '  '^[t+sJJCv'd) 

I  r'  y  c 

+  ,r  ,  dsf'  UL,  t+sj!HHy  [t+s]  yl 'ft,t  +  s  )  -  ri  [t  +  slvt(t.t  +  s)lCv‘; 

"t  J  Q  v  i  -*  u  T 

'5.10) 

It,  t  +  s)  =  {-  (Y^(ofc(t),  zc(t +•■!'■ 

In  (5.10)  we  usod  the  do  fin  it  ion 

t  A  ,s  ^ 

[t+s]  £  T‘—  Y ( 0  *”  I  t  )  ,  =  l'(t+s)  )  +  -y-  s  i  n  (o  ( t )  -  o'(t!) 

for  the  arguemee.t  of  ( •  )  ,  and  the  ( • '  are  del ined  by 

Y^(V,  ^(t  +  s)  )  =  [r.  *'(t  +  s  )sin  v'  + 

V  t  (6"  z  t  (t  +s  ) )  =  [z^(t+s)cos  -  z ^  (t  +  s ) s in  ). 

1  he  second  term  of  (5.10)  occurs  since  gu[t+s]  depends  on  J  ( t ) . 
Now  note  the  important  fact  that  for  each  fixed  t,  the  "vocesses 
Y^(ejt),  z' ■ t  +  . )  >  and  Y^(-(t),  2t(t  +  * ) )  are  independent .  1  hi  s 

property,  which  will  be  used  frequently,  is  due  to  the  Gaussian  as¬ 
sumption  on  the  a .  f - i .  Without  it  the  o  JB  in  (5.5)  would  he 
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replaced  by  a  more  complicated  expression. 

The  first  term  in  (5.10)  can  be  shown  to  satisfy  (5.8),  and  so 
does  the  component  of  the  second  term  which  is  linear  in  A(1  if  (5.8' 
is  divided  by  a ,  By  the  independence  cited  in  the  last  paragraph, 
the  expectation  term,  f  Ra  1 1  +  s  ]  (U  L  ( t ),?.''(  t  +  s  )) ,  in  the  second  com 
ponent  of  ;5.1iM  is  zero,  and  the  conditional  . xpectation  there 


1  s  - 


1,1 


It+sJKpj  r‘S  t  +  )  = 

:q'L  1  t'-u  I f  *s ! f  1  >'/q ^  )v  Ji ; 1  ( t  i , : .c  1 1 1  j . 


from  this,  some  m 

an i pul  at i on 

s  using  the 

change  of  variable 

> /' p 3  k  s  and  tin 

facts  that 

1  g  t  (  u  1  1  • 

K/.i  and  that  g  ( i:  '  -  r- 
'  u 

fo 

u ;  >  ■'  \"i  e  1  d  that 

the  remain iny 

component  of 

i 3 .  ! ' )  is  bounded  !*v  i'3.si 

I  lie  third  ten  of 

l  3 . T )  can 

he  treated 

in  t  n e  same  wav  as  i  to 

second  was  treated  and  with  the  sane  result. 

Ihus  p  -  1  i  in  |Jn<^  +  3*^  tern  of  i3.d)]  =  it. 

t  -a 
-  -0 

nnly  the  last  tern  of  i  3 .  V  1  remains.  The  part  of  the  ten; 
which  contains  the  (Jtv'  lllu^.l  component  ot'  v"  is  also  ho-mdod  In  (  n..O. 
Thus,  it  is  no  .eligible  and  on  1  v  the  remaining  coimionont  of  inf1',  which 
contains  the  Ii(u^  -  fu^)  part  of  vb  must  he  averaged  further.  We 
denote  this  component  by  kL  and  write  it  in  the  form  i  3  .  1  J  ’  . 


kL(t,sett)) 


1 

q! 


ds  ir  f  (.\  ( 1 1 , t+s  in- 
1  v\ 


« 3 .  i :  i 


fl':tSa[t+s]  '  1;S«  It  +  Sl  1  ^Kai  T  r  1  *  1 1  1  } 


1  ‘1 


where  [ t ] ,  [t  +  s!  are  defined  below  (3. 10) (the  expectation  is  onh 
over  the  g  4  1 1  +  s  j  t  e  rm  )  .  ibis  tern  is  not  neg.  1  Liable  and  must  ne 

a  ve  raced  i  art  her.  Me  fine  the  second  perturbation  N  i  r  )  -  f5;  ;  ^  -  * 

whe  re 

N  =  !  dc  [Ii^kL  (t  +  :  ,'3h  -  Hi*"  i  t*t  ,0)  )  .  3.13  ! 

J  0  T 

It  van  he  shown  that  I  I'*'  •'  t  i  '  •  it  (  q  “  l  |  1  +  ;  ;;  ^  <  *  ,  "  '  t  that 

f '  s  •  €  '&•  \  ■  and  t  hat 


A  f  ^  ( t. )  -  -(3.12) 


Ik  c  (  t  N  ( t )  ) 


3  .  1  -1 


+  (terms  whose  p-lim  is  zero). 


The  last  term  on  the  right  side  i  s  [l  +  (  t  )  I  :>1 0(qc/-O  . 

The  middle  term  of  i3.M)  minus  ll'f  (x  (t),t)Ha“/2  tends 
to  zero  in  the  n-lim  sense  as  ^  ■*  0 ,  a  -*■  p.  This  last  result 
follows  by  the  same  sort  of  argument  as  used  in  14],  Section  n. 

Summarizing  the  above  calculations  and  using  the  f  (*i  - 
f  (  x (•),•)  «■  fj'i*)  +  f  ,(•  '  yields  that  the  two  required  limits  el 
Thoorrml  hold,  where  A  is  the  operator  of  (3.31;  i.e., 

p  -  1  i HI  !AL  r d  •  )  -  +  A  )  f  (  x  c  (  •),*}]  ;  ’* 

a  *0 

►(! 

|,  I  I  in  1  i  'in  |  n  ,  I  I  .  . 

i  •  ii  1 
.  .  i) 


Hv  |  a  1  ,  I  hen  torn  1,  tightness  ot  1  x 

v  v  L-  . 

given  bounds  on  (  .  (  •  )  am!  on  A  I  !  ■  1  . 
weakly  to  the  solution  of  (3.3)  as  1 


loll ow s  t  rem  t  he 
•  he  ;  x  '  !  •  )  x  on ve  rge 


•  i’  , 


-  0  . 


II.-.  I  lie  Svstem  with  the  Limiter  of  Figure  lit 


Now,  tin  c  a  (.  ■  i  of  111.1  is  replaced  by  sign(-)  =  g  (  •  !  and 


u'  is  replaced  by  u “  where 


u“(.t,°L,-’]  =  --  siyn[^-  Cj(t)  cos  t>  L  (t)sin  o 

*  L  ‘  t. 


+  —  s in  (U  -u 


,  a  l  FT 

and  (3.6)  holds  i'u  used).  Also,  l  it  (t.u  ,  6)  J-  sin(v-d  )  +  0(q  \  . 

The  function  f !.  •  1  is  still  defined  by  (  X .  ?  j  tu  used)  and  i3,S> 

still  holds.  Note  that  the  distribution  of  (write  d  =  -J  (t) ,!-!  *  (t  ,1 1 

e  ^  c  £  "■  (_  ~  £ 

[z,(t  +  s)cos  v  -  z ( t  +  s )  s  in  ■  -  sinfv-i.  )]  condi  1 1  oned 

on  data  up  to  time  t  is  N'  (mean t  (s )  ,  var^fs)),  where  N(u,P)  is  the 
normal  distribution  with  mean  u  and  variance  P  and 


mean  \ s 


fs/q“)  (  -  "  ft)  cos  u  C  -  z  \  ( t )  s  i  n  ■-»  c  i 


‘  t  l 


O’t 

-- —  s  i  n 


v a  r ”  (  s <  =  1  -  f  "  ;  s /q “  )  . 


It  is  convenient  to  write  f j ( • J  in  the  more  explicit  for 
f  o  .  1 5  j  ..with  obvious  notation  ,  fj(t)  -  f  ;  t  t  ,  c  ( t  :  ,d  '  (ti  1  where 

.  c.  '  L 

t  |  I  t  ,  9-j  j  i  defined  by 


-  l 


e  J  0 


,t  +  s)li|| 


L 

(.sign  g)dN(mean  (.s'),  var  (s)) 


(3. 15) 


’  A0qe  «c  ) 

(sign  4)dN( — - —  sin(d-v  )  , I j !d  s 


21 


it  can  be 

b  v  (  .) .  1  5  ) 

shown 

tii  at 

f^('J  €  <2>(At')  and  that 

^  c  £. 

A  f i ( • )  is  given 

=  •  f :  X  ’ 

t  ,  ,t  )H(u£'(t/JL(t  j.Jftj)  -  i:u£'<t,bt 

(t),b(t)JJ 

♦  L.  ? 

J 

to 

U'v 
0  r 

i  ) 0 d s  0  ( t  )  i 3. lb) 

+  1  f 

X> 

(r;-! 

0 

O'.ds  v ^  ( t )  , 

where  ' 

i  s 

t  he 

inter. rand  in  (3.7)  with 

u.t  replaced  by  uL. 

When  calculating  the  derivatives  in  (3.1b),  we  use  the  explicit 
representation  (3. l 3) ,  so  only  derivatives  with  respect  to  para¬ 
meters  in  the  normal  density  function  are  taken .  No  derivatives  oi  the 
sign  function  are  taken.  Proceeding  as  in  the  preceding  subsection, 
the  first  two  integrals  on  the  right  side  of  (3. lb)  are  hounded  by 
(3.8).  Modulo  a  term  which  satisfies  (3.8),  the  last  term  of  (3.1b)  is 

/'CO 

— i  ds  ll’f  (xc'(t),t  +  s)H(F.Sign[t  +  s]  - 

q“e 

-  V.  sign [t+s ]) (sign [t]  -  I  sign[t]), 

where  [t],  [t+s]  are  defined  below  (3.10). 

The  rest  of  the  development  is  exactly  as  in  Section  III.l, 
except  that,  when  taking  derivatives  in  the  calculation  of  A  f,(0» 


the  explicit  form  of  the  expectation  and  conditional  expectation 
are  used,  analogous  to  what  was  done  with  f|(')>  and  the  hound  helo>* 
(3.14)  is  replaced  h y 

0  r  q  &  J  [3  +  i  :tCt)  I  3)  (3.K) 

The  limit  : =  still  (3.3). 


IV.  The  i^uadr  t  corre  1 _ator  Without  A  limiter 

I'he  svsten  ami  some  of  the  notation  is  piven  by  liyure  As 

in  Section  Ill,  the  equations  definimt  the  linear  filters  are 
me  re !  v  state  variable  representations  of  low  pass  filters.  The 
noise  model  n '  ^  of  Section  Ml  is  used  here  and  in  the  next 

sect  ion.  hot  the  initial  f requeue'  error  not  defend  on  ■  .  and  s^-t 

w '  -  w  •'t.“ ,  w"  "ii  ’  *  :u>'i  K,  1  .  absorb  it  into  \,y .  o  t .  for  the  umvr 
filter,  let  V.l'j  =  0.  this  is  necessary  to  guarantee  that  the 
limit  o  t'  the  intuit  as  c  >  ni  to  the  d  i  !’ i’e  ron  t  i  a  t  o  r  is  differen¬ 
tiable.  This  restriction  is  normal lv  satisfied  in  practical  sestets. 
Now  the  system  state  is  x  '\.,v,,s  ).  \s  in  Section  11.  th.e 

noise  center  frequency  need  not  be  .  provided  that  (noise  center 
frequency  minus  -JbqJ  ‘  0  as  t  -  0 .  The  purpose  of  the  svstem 
[  o  j  is  the  estimation  of  and  track'iny  of  the  tpossibly  time  varviny I 
input  frequency.  Unlike  the  phase  looked  loop,  the  input  to  the 
V'dO  depends  on  a  frequency  as  well  as  a  phase  error.  See  the 
heuristic  comments  in  (31.  which  are  repeated  below  ( -1  .  11  .  We  use 
the  assumpt  ions  on  A  and  :l  *.>1  the  previous  sect  ion. 

fhe  analvsis  is  very  similar  to  that  ot  Section  111,  and  onlv 
a  few  details  will  he  given.  The  sequence  lx  Mil  converges 
weakly  to  \  (  •  1  -  ( v ( f • 1  ,  v  ,  ( • 1  ,  0  (  •  1 1  .  where 

An  °: 

dVj  ■  lljVjdt  +  v  ll^sillfAuit  +  J  -  U)dt  +  -  lljdBj 

An  -  0  ’ 

dv ,  =  l\v,dt  +  v  1 1,  co  sfAujt  +  0  e  Kit  +  ,  “  H  ,dB  ,  (4.1) 

#uo 

dd  =  vjUjCjf  ,V-,dt  ,  o",  =  o-  j  P  ( s  Ids  . 
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I’rocoovliny.  ms  in  Soot  ion  III,  lollovsinp.  tho  argument  ho  low 
anil  ilroppino  tho  tonus  slropposl  thovo,  tho  inputs  to  tho  linear 
tiltors  at  time  t  .no  in  (  t  .  t  ,  0  L  ( t  1  ,  0  1 1  )  1  ,  i  1.;.  Then 


■w— ■  -  _  irfii— mAei 


where  k  !  x  .  t  '  is  now  tie  !'  i  ned  to  he  i  r|  <  x  .  *  '  !  ’  \  ur 

•  ,  x 


K  (  X  ,  t 


2  f  f  c  ,  ,  o 

"S  ]Hirv  V  !x  ’t+s)!!i!:rU’  ’  !t*‘ 
4 o “  1  0(  1  ! 


+  1 1 ;  r  (. x‘  ,t+sin  ,i ./.i^ ,0  f  t  ,t  +  s , :  ■  )u\ ''  1 1 , t . 

i  V ,  v  ,  *  -  * 


♦  n;rv^.  (Xc  ,  t  +  s  M!j  !  :‘'u^  ’  (  t ,  t  +  s  ,  • 


11,  1  ,  •  .  ' 


♦  !'’,rv  v  (  xc  ,t  +  s  111,1  Ju  V  (t, 


Lj  0  f  t .  t +  s . .  '  mi  v 1  :  t .  t .  - '  ^ 


■S  ,  -  Ml 


*  terns  hounded  by 

l  or  each  t  and  x"  ,Uj  ’  '  f  t  ,t  +  •  ,  •  /  is  i  ndepende  ’ ‘  e  ' 

’■'(  t  ,  t +  i  and  the  expectation  of  the  second,  and  third,  cor  no: 

of  the  integral  (4.7)  are  :cro.  Actual ly  only  orthogora 1 i ty  and  n 
independence  is  required  here.  !>e  1'  i  nj  m;  rd'-.!  v  "  •  •  •'  •  u  ‘ ' 

show  that  f;i  •  )  is  hounded  by  (3.  1  "*  ■  and  Hi  •  >  6  J  <  \  !  and  tin 

(writing  x  ~  =  x  '  ( t  )  ) 

AefJ(t)  =  -  (  k  '  (  x  \  t )  -  lik"(.\t,t '  1 
+  terms  bounded  by  13.!"'. 


Changin''  variables 
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•„  *n 


v, 

J 


32 


VI .  The  Squaring  Loop 


In  this  section,  we  do  an  asymptotic  analysis  of  the  system 
of  Figure  4,  whose  purpose  is  to  "track  the  carrier  frequency" 
irrespective  of  the  input  modulation  process  mt(-)»  h’e  will  study 
the  effects  of  the  m  ( • )  on  the  estimation  error  process 
(a£(.)  -  oL(-J)  for  small  noise,  and,  eventually,  do  a  linearization 
analysis.  For  notational  convenience,  scale  such  that  K7  =  1.  In 
a  sense,  the  procedure  below  is  an  attempt  to  rigorize  the  heuristic 
analysis  of  Gardner  [  3 1  ,  Appendix  B.  The  limit  equations  are  given  in 
(6.14)- (0.13). 

For  specificitv,  let  the  transmitted  signal  be  pulse  phase  shift, 
or  amplitude  modulated  in  the  following  way.  We  will  scale  the  orobler 
so  that  a  meaningful  result  can  be  obtained  for  small  pulse  widths 


and  small  noise.  Let  p(*)  denote  a  realizable  transfer  function, 
continuous  for  t  >  0  and  right  continuous  at  0,  and  set  PL(t)  = 
p(t./q“),  where  e/q£  +  0  as  t  ►  0.  Let  { a^ )  be  a  sequence  of  bounded 
zero  mean  independent  random  variables  with  unit  variance,  and  set 

<v  ? 

m  .  ( t 1  =  L  a,p  (t-kT  ),  where  Tv.  =  Tq  “  denotes  the  width  of  the 

c.  i  K  -  t  c 

k  =  - «• 

pulse  interval,  T  being  some  given  constant.  Suppose  that  there  is 


a  bounded  non - increas ing  function  p ( - )  such  that  |p(t)|<  pit)  and 

•  CO  ,(X> 

I  dt  du  p(u)  ■T'.  The  general  technique  of  this  section  can  he 


'  0  '  t 

used  with  a  greater  variety  of  modulation  types,  and  the  independ 


'  L 


ence  of  {a, }  can  be  weakened.  The  input  noise  n  (•)  has  the  form: 


nt(t)  =  [ z ^ ( t ) cos  wjt  +  Z2(t)sin  «Jt]o. 


whe  re 


-  vl  - 

K  (  * '!  and  "  ?■  ( •  1  are  defined  in  Section  III. 

i  "  i 

In  this  section,  the  analysis  is  done  for  small  noise,  as  essentially 
assumed  i  r:  j  ,  Anpendix  I),  ;o  we  do  not  divide  n  [•)  hy  i|  £ 

'-.uppo  *  i . :  1 1  '  =  0(q  J,  and  1  hat  the  z.f-)  are  independent  of 

The  scaling  is  of  the  correct  order  for  a  meaningful  problem. 

The  signal  and  noise  RK's  are  both  Olq  "').  The  sequence  ■' a.  ’■ 

is  the  transmitted  signal  sequence  and  the  p  ( • 1  yields  the 

transmission  channel  behavior  ("intersymbol  interference").  The 

"memory"  in  the  "symbol  interference"  system  is  roughly  the  same 

number  of  pulse  intervals,  irrespective  of  c.  Also,  for  small  , 

the  average  noise  energy  per  pulse  interval  is  of  the  same  order 

as  the  signal  energy  in  that  interval.  With  an  i napp ropri ate  scaling, 

the  problem  would  deeenerate,  as  v  +  0,  to  one  in  which  detection 

f  r  ( 

was  either  perfect  or  purely  random.  In  our  case,  I:  [ f  Ln  is)ds|“  r 

-1  J° 

O(Tt)  and  ’  1  signal  (s)  +  n  (  s )  J  cl  s  -  \[0(T  ),0{T“)].  So  the 

t  •'  0  c  t  ' 

detection  problem  does  not  degenerate  as  t  *  0 . 

Since  we  wish  to  work  with  small  errors  and  to  eventually  do  a  valid 
linearization,  let  o  (h)-tl  (0)  =  0(q£)  .  This  will  guarantee  that  60  (t) 
f j  °  ( t  1  -  ;  f t  I  =  Ofq  )  for  any  finite  t.  If  we  wish  to  assume 
vj  l  ( 0  j  =  Olq'M  for  some  x  e  (0,1),  then  a  different  scaling  would 

r. 

he  used  in  the  sequel,  but  this  point  will  not  be  pursued. 

The  circuit  of  Figure  4  was  investigated  by  Gardner  1 3 j , 

Appendix  R,  and  elsewhere,  using  good  engineering  intuition,  hut 
without  the  benefit  of  the  asymptotic  theory,  and  required  some 
ad-hoc  assumptions  (e.g.,  holding  the  state  variable  JL(t)  fixed 
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t r'Mii-  bout  an,!  r-'ing  "approximate"  spectral  methods  on  a  non- 
lin-.-a:  or  oh! cm  .  An"  verification  of  that  technique  and  result 
♦  anna  ran?  1  v  deal  with  an  "asymptotic  situation"  scaled 
es  sent i a  1 1 v  as  a hove . 

The  analysis  is  started  in  a  conventional  way,  by  making  certain 
expansions  and  dropping  some  of  the  terms.  This  procedure,  comment ed 
on  below,  can  hi-  vigoriced  at  the  expense  of  additional  detail  and 
notation.  First,  square  the  input,  expand  the  products  of  the  obtained 
trigonometric  functions  in  the  usual  way  in  terms  of  the  sums  of  sines 
and  cosines'  of  the  sums  and  difference  of  the  angles.  Drop  the  terms 
whose  sin  or  cos  factor  does  not  contain  a  We  suppose  that  the 

suuarer  contains  a  linear  high  pass  filter  which  does  this.  Since 
the  FHV  of  the  dropped  terms  and  the  BIV  about  of  the  retained 

terms  is  CHq  ~K  there  is  no  problem  in  explicitly  introducing  such 
a  filter,  but  it  unnecessarily  complicates  the  notation.  Next,  having 
dropped  the  cited  terms,  multiply  the  remainder  by  the  VC.O  output 
sin  ?  ( ~(jt  +0  ( t )  )  ,  expand  the  products  of  the  trigonometric  functions 
as  above,  but  now  drop  the  terms  whose  sine  or  cosine  factor  contains 
an  ^  in  the  argument.  We  suppose,  as  in  previous  sections,  that 
the  multiplier  contains  a  low  pass  filter  which  does  this.  In  fact, 
such  an  assumption  is  not  necessary,  and  if  the  dropped  terms  were 
carried  through  the  analysis,  they  would  not  affect  the  limit.  But, 
for  notational  convenience,  it  is  helpful  to  drop  them  at  this  point. 
Denote  the  resulting  term,  the  multiplier  output,  by  u^ft)  = 
ut(t,  ti£(t)  ,^L( t) ) ,  where 


7,f 


z|(t)cos(Ot-Ztb]  +  \  [((^(t))2  -  UjltlTlsin  2a?t 


+  2  z  ^  ( t  J  z  ^  ( t )  cos  20c'] 


( o  - 1 J 


Define  =  (ut'-6“)/q_  ,  X  =  vVq^-  Then 


r'lVV-tJ 

xi  s  ;,xi  +  ,i[ - r— 


sin 


ilK«cni(^ti)  ,  t  *\  >■  c  t  j 

*  si - i -  [  -  z  j  (t )  s  in  (o  t  -  20  “)  ♦  ^(t)cos  (0  -2v  )  ]  (6.2aj 


,2  t r z c t ) ) ^  -  u^(t)D 

+  *±z_.  [  — I -  - -  sin  2U  + 

T  1  q 


2zt (t) z\ (t ) 


cos  2W 


)sin  2  ( -0  .)  UK  .o  t  t  ,  L 

=  Ox,  +  H[ — 1 - t - - 1  +  v  (t,o  ,o  )m  (tj 

1  1  u)  2q  1  t 

2 

+  U5_  ySt,/'/)  (.  h  •  2  b  J 

A  / 1  ' 


Xi  =  -  Cx]» 


(b. 2c J 


where  ('tS.2  l  defines  the  v  •  )  .  Owing  to  the  normalization,  wo  re 
quire  that  t  ( *  ) /q  converge  to  a  right  continuous  function  0  •  •  j 
(.with  left-hand  limits)  as  e  •>  n,  or  else  we  deal  with  a  subsequence 
which  does  converge.  We  assumed  0  =  0('q  >  in  order  to  he  able  to 

do  the  linearization  analysis  below.  For  such  a  linearization  to 
be  valid,  we  must  have  0  (*)-*0  as  ^  0 .  If  the  rate  is  slower  than 

0  f  q  )  ,  the  effect  of  the  d  ^  ( • )  variations  on  the  tracking  errors  in¬ 
crease  to  05  relative  to  the  effects  of  the  m  (.  •  1  and  nLf«).  Our  scaling 
is  the  unique  one  for  which  the  noise  and  d  *"  (  •  1  effects  are  commons - 
u  rate  .  fo r  sma I  I  t  0  . 


I'e  fine 


-  ][  I  £  1  I  f  ^  Ly  2 

e“  =  r,—  limps  Ids  =  7T.  i  p  (s-kf)ds. 

m  ‘t  JO  L  1  J0  k=-«*> 

We  now  follow  a  procedure  very  similar  to  those  ot  the  previous 
sections,  again  omitting  most  details.  The  main  dilterences  being 
due  to  the  periodicity  of  lm“(si  and  of  ((>.91  ,  which  forces  us  to 

~  t.  L 

use  an  additional  averaging.  We  liave  sin  J  ( c  -v  )/q^  =  2x,  + 

\‘"  o  l  |  -j  -  v  '■  I  1  .  Owing  to  the  assumption  on  the  initial  conditions, 
if  the  ()(•!  above  were  carried  through  the  analysis,  it  would 
contribute  nothing  to  the  limit.  For  convenience  in  the  analysis 
here,  it  is  dropped  henceforth  and  we  replace  sin  2(dL-utlA|i  in 
(0.2)  hv  2x^.  This  must  be  kept  in  mind  in  the  manipulations 

-  -  -  .  .  -  -  —  "  l  ‘ 

below .  We  use  the  form  f*  *"  ( t  )  =  ffx^.t)  +  £  f  V  ( 1 1  for  the  perturbed 

i  =  0  1 

test  funct  ion  . 

As  usual  for  f  ( •  )  £  (write1  x  L  =  x c  (.  t  )  )  , 


A"fixL,t)  =  l*  c x c , t )  +  r;  ;xL,t)*J  ♦  f*  (x^m" 
t  x  1  1  x  2 


(0.5) 


Again,  the  components  of  (0.5)  containing  the  processes  m  (•)  or 
I  •  )  must  he  averaged  out.  The  first  term  which  we  will  average 

L  0  }  * 

out  is  P(x  ,  t  )  II  [  -  K’Tm:  (t  )  x  J  2  J  .  For  this,  we  use  the  test  function 

X  1  t  ^ 

perturbation  f(^(t)  =  f^(x  (t),t),  where  we  define 


a,  t 

f0U  ,t)  = 


-  K  r 00 

~V~  f;  (xL,t  +  s)m  L[m2(t  +  s)  -  o2  ]  x^ds 

*•  1  q  p  >c  m  2 


vll 

hqc 


— -  f’  (x\t+q2S)HI^  [»2ft+q:s)  -  o2jx!;ds 
*■  Jg  t-  re  t  m  2 


(6.4) 
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L  7  t 

By  the-  assumptions  on  p(-)  and  on  !a,;,  IT  m“(t.+q“s) 

K  t  ^ 

i  n"  (-*--*  +  s  kT>  5 L  (  t  ,  s  i  -  0  as  s  ►  and  is  inteprable  in 

<o  q  - 

s,  uniformly  in  t  ,  >-  .  Since  the  above  sum  is  periodic  with  period  T, 

we  center  m”|-i  about  its  arithmetie  mean  o~  in  (0.4).  The 

t-  ■  m 

integral  in  10.4)  is  0(q“). 

We  have  f  ~  (  • )  €  ^(Aw)  and  it  can  readily  be  shown  that 


U 


,t  ! 


K  w  \ 

4  —  f'  (.  ^  b  ,  t ) !  I  ( in  *"  ( t )  -  T)  + 

*•  A  |  III  *- 


Thus,  the  m  “  (  •  )  term  in  (0.2)  contributes  only  its  mean  value 
to  the  limit  equation.  See  (0.11)  tor  the  summarizing  calculation. 

Next,  we  average  out  the  "remain  ini:"  noise  terms  in  (0.5). 
This  requires  las  usual)  fj(xL(t),t)  -  fl(t),  where 


fj(x\t ) 


p”  „K.  t  v,(t+s,^|t],L'l)m  (t+s)ds 

!  (x  ,t+s)l£  - - - - 

J0  2  V  r 


r 


11' f  ( x  ,  t + s )  I  ". 
XI 


\4(t+s, 1 1  ,dL)ds 


t  J 


t 


lh 


!  o .  r> ) 


As  usual,  the  "remaining."  noise  term  in  (0.5)  is  iust  the  sum  of  the 
integrands  in  10.5),  evaluated  at  s  =  0.  By  usiny  the  change  of 

1  c. 

variable  s / tj “  *  s,  we  can  show  that  1  ft  )  is  bounded  hv 

0(qj  [1  +  |  :e(t)  !:| . 

Proceeding  as  usual,  we  next  pet  that 


0) 


■\ 


,tj  = 


+ 


-  -n  _ 

-  f i nt egrand  of  (6.5)  evaluated  at  s  = 

(6.6  ) 

(terms  whose  p-lim  is  zero)  +  (f  (x L  ,o L ( t )  ,  t ) , 

C-y  0 


whe  re 


Q  (x  ,6  (t),t)  -  (f.  (x  t))'  •  (last  two  terms  or  rirhf  side 

’1  ( o . " ) 

of  (6.2a)). 


The  second  term  on  the  right  side  of  (6.6)  is  bounded  by 

0(qe)ll+|Z£(t)|^|.  Actually,  Qfc'(xt,dt'(t),t)  is  just  (6.5)  with 

f  replaced  by  f  and  multiplied  on  the  rieht  bv  the  last 

X1  xlxl 

two  terms  on  the  right  side  of  (6.2a). 

Using  the  mutual  independence  of  the  { z ^ ( - ) ,  i  =  l,2,m  (•)) 

processes  together  with  the  fact  that  the  ?.jM  have  mean  zero  and  are 
_  ,  2  ? 

Gaussian  and  that  sin  u  +  cos“u  i:  1 ,  we  get  that 


hQSxV-Mt)  ,t) 


H ’  f  v  (xt,t+s)HP(s/q“  )I:J1!  (t+s)ni,  (t)ds 
0  xlxl  "  L 


+  4  (r)^  f  If’f  (xt',t+s)Hp2(s/q^)ds, 
q“  J0  X1X1 


(6.8) 


where 


i:mL(t  +  s  )mL(  t  )  =  l  pt(t  +  s  ■  kTt)p£(t-kTL)  . 
k  =  -o° 


(  6  .  9  ) 


The  expression  (6.9)  is  periodic  in  t  (period  T  ) . 


Because 


of  thi 
d  e  f  i  n  i 


f;cx 


periodicity,  an  arithmetic  average  nf  (6.0)  is  used  in 
nc  the  centering  term  for 
Let  us  write 


1  (  7 
rr-~  l  I'm  (t  +  t  +  s)m  .  (t  +  t)dt  =  V  ( s  /  q  j 


1 


•  'Y  00 

1  !  l  p(^  +  I  -  kT)p(%  +  -  -  kTldi 


•  0  k  =  - i0  q  " 
>T 


0- 


J  !  I  p(^  +  i  -  kT)  p  ( t  -  kT  I  d  i . 
0  k  =  - 10  q  “ 


Now,  define  !',(•)  by  f^(t)  =  f  ■ftx*’  ( t )  ,  t )  ,  where 


c  t)  - 

%  L  )  ~  1 


K  J 


f  di  r dsll’ 

0  J0  11 


t  «. 


(6.10) 


di  dsll’f  ,  (x  ,  t+t+s )!  1{  li  [  v7  (,t+  t+s)  v.  ( t  + 1  )m  it*  i  +  s  >m  ( t  +  t)  | 

n  X.X,  t  1  i  c  t 


-  P(s/q")V(s/q“)  ) 


K:a  2  2r  ^ 


T  (£*-)  dt  ds  II*  r  (x\t+t+s)lll'!'fv'T(t+t+s)m  (t+t+slv^i t+t ) 

2q“  4  0  JO  Vl  1  1 


+  V2(t+t+s)v^(t+t)mt(t+t)] 


(6.11) 


i.  t. 


dt  dstr  r  (x  ,t+t+s)Hi H  v_(t+t+s)v7(t+t) 

XiX  i  L  Z  *- 

J0  1  I 

Lv^ (t+t+s )v^( t+t) } . 


Ihe  centering  term  in  (6.11)  is  precisely  (6.8)  but  with  l-jn^(t+s)mL(t) 

Z  t 

replaced  by  its  a r i thmeti o  mean  V  ( s  /v  ~  ) .  it  can  be  shown  that  f?(t)  is  bounded  by 


-  n  - 

0  Cqf )  l 1  +  i  Z^ft)  !6] 


(b.  12) 


and  that 


A~f,;t;  =  (  6.3j  (but  with  I:.m  i  t  +  s ) m  ( t )  replaced  by  Y(  s/q“)' 


Q~  (.<  '  f  t')  ,'J  (t),tj  +  terms  satisfying  (6.12). 


16. 13) 


Summarizing  the  above  calculations  and  writing  xL  for  xC(t) 


v  i  e  1  d  s 


p-lim  [  l  f-Cx^.t)]  =  0 
e-»0  i  =  0  1 


p-lim  [Atfe(x‘',t)  -  (~  +  A)f(xL,t) }  =  0, 

t-0  °r 


where 


K2a2x 

A  f  ( x  ,  t )  =  c;  (x,t)  [Dx.  -  ]  ♦  f  (x,t)[6-Cx 

x  l  1  z  2 


•  c° 


P  (s)ds  + 


v2  2 
KjO  ,«> 


0 


(6-14) 


P (s ) V (s ) ds ] H ’ f  (x,t)H. 
0  11 


Tightness  can  also  be  shown  by  applying  i 6 ,  Theorem  1]  with  the  given 
order  estimates.  By  Theorem  1,  {xt(-))  converges  weakly  to 
x(  •  )  =  Cx]  !  ' )  ,x2( • )) ,  where 

dxj  =  [Dxx- H  K2o2x2/2]dt  +  /z  OjHdB 

dx,  =  [tf  -  Cx^]dt,  (6.15) 


B(<)  =  standard  Rrownian  motion, 


-  42  - 

where  is  the  last  bracketed  term  in  (6.14).  With  non- 

2 

Gaussian  noise,  the  limit  is  the  same  except  for  the  value  of  o^. 
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